Jul 18 05:32:15 devstack cinder-volume[76316]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 18 05:32:15 devstack cinder-volume[76316]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 18 05:32:15 devstack cinder-volume[76316]: we strongly recommend against using it for new projects. Jul 18 05:32:15 devstack cinder-volume[76316]: If you are already using Eventlet, we recommend migrating to a different Jul 18 05:32:15 devstack cinder-volume[76316]: framework. For more detail see Jul 18 05:32:15 devstack cinder-volume[76316]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 18 05:32:15 devstack cinder-volume[76316]: import eventlet # noqa Jul 18 05:32:17 devstack cinder-volume[76316]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:32:17 devstack cinder-volume[76316]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:32:17 devstack cinder-volume[76316]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:32:18 devstack cinder-volume[76316]: INFO dbcounter [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Registered counter for database cinder Jul 18 05:32:18 devstack cinder-volume[76316]: DEBUG oslo_db.sqlalchemy.engines [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:32:19 devstack cinder-volume[76316]: DEBUG dbcounter [-] [76316] Writer thread running {{(pid=76316) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:32:19 devstack cinder-volume[76316]: INFO cinder.rpc [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 18 05:32:19 devstack cinder-volume[76316]: INFO cinder.rpc [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 18 05:32:19 devstack cinder-volume[76316]: DEBUG oslo_db.sqlalchemy.engines [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:32:19 devstack cinder-volume[76316]: INFO cinder.volume.manager [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Determined volume DB was empty at startup. Jul 18 05:32:19 devstack cinder-volume[76316]: DEBUG cinder.volume.manager [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76316) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 18 05:32:19 devstack cinder-volume[76316]: INFO cinder.volume.manager [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 18 05:32:19 devstack cinder-volume[76316]: WARNING stevedore.named [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 18 05:32:19 devstack cinder-volume[76316]: WARNING castellan.key_manager [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:32:19 devstack cinder-volume[76316]: WARNING cinder.keymgr.conf_key_mgr [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:32:19 devstack cinder-volume[76316]: DEBUG cinder.volume.drivers.lvm [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76316) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 18 05:32:19 devstack cinder-volume[76316]: DEBUG oslo_concurrency.processutils [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:19 devstack cinder-volume[76316]: DEBUG oslo_concurrency.processutils [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] CMD "cinder-rtstool verify" returned: 0 in 0.421s {{(pid=76316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:19 devstack cinder-volume[76316]: DEBUG oslo_db.sqlalchemy.engines [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:32:19 devstack cinder-volume[76316]: INFO cinder.rpc [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 18 05:32:19 devstack cinder-volume[76316]: INFO cinder.rpc [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 18 05:32:19 devstack cinder-volume[76316]: WARNING stevedore.named [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 18 05:32:19 devstack cinder-volume[76316]: WARNING castellan.key_manager [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:32:19 devstack cinder-volume[76316]: INFO cinder.volume.manager [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_db.sqlalchemy.engines [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:32:20 devstack cinder-volume[76316]: INFO oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Starting 1 workers Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Started child 76463 {{(pid=76316) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Full set of CONF: {{(pid=76316) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] ******************************************************************************** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Configuration options gathered from: {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] ================================================================================ {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] allow_availability_zone_fallback = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] allow_compression_on_image_upload = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] allowed_direct_url_schemes = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] api_rate_limit = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] auth_strategy = keystone {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] az_cache_duration = 3600 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_availability_zone = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_host = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_stats_polling_interval = 60 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backup_api_class = cinder.backup.api.API {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backup_name_template = backup-%s {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backup_use_same_host = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backup_use_temp_snapshot = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] chap_password = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] chap_username = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cinder_internal_tenant_project_id = d838faffc97147d4afe348d3b4eb9b10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cinder_internal_tenant_user_id = b19d351167334f239b2ff27067a63089 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cloned_volume_same_az = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cluster = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] compression_format = gzip {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76463]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] compute_api_class = cinder.compute.nova.API {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] config_dir = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] config_source = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] control_exchange = openstack {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] debug = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] default_availability_zone = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] default_group_type = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] default_volume_type = lvmdriver-1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] disk_geometry = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] driver_client_cert = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] driver_client_cert_key = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] driver_data_namespace = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] driver_ssl_cert_path = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] driver_ssl_cert_verify = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] driver_use_ssl = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] enable_force_upload = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] enable_new_services = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] enable_unsupported_driver = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] enforce_multipath_for_image_xfer = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] filter_function = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_api_insecure = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_api_ssl_compression = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_ca_certificates_file = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_catalog_info = image:glance:publicURL {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_certfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_keyfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_num_retries = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance_request_timeout = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] goodness_function = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] graceful_shutdown_timeout = 5 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] group_api_class = cinder.group.api.API {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] host = devstack {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_compress_on_upload = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_conversion_address_space_limit = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_conversion_cpu_limit = 60 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_conversion_disable = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_upload_use_cinder_backend = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_upload_use_internal_tenant = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_volume_cache_enabled = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_volume_cache_max_count = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] image_volume_cache_max_size_gb = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] init_host_max_objects_retrieval = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] instance_format = [instance: %(uuid)s] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] iscsi_target_flags = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] iscsi_write_cache = on {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] iser_helper = tgtadm {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] iser_ip_address = 192.168.122.21 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] iser_port = 3260 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] log_color = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] log_config_append = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] log_dir = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] log_file = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] log_options = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] log_rotate_interval = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] log_rotate_interval_type = days {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] log_rotation_type = none {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] max_age = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] max_logfile_count = 30 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] max_logfile_size_mb = 200 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] max_over_subscription_ratio = 20.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] message_reap_interval = 86400 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] message_ttl = 2592000 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] migration_create_volume_timeout_secs = 300 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] monkey_patch = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] monkey_patch_modules = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] my_ip = 192.168.122.21 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] no_snapshot_gb_quota = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] num_iser_scan_tries = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] num_shell_tries = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] num_volume_device_scan_tries = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] nvmeof_conn_info_version = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] nvmet_ns_id = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] nvmet_port_id = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] osapi_max_limit = 1000 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] osapi_volume_ext_list = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] osapi_volume_listen_port = 8776 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] osapi_volume_use_ssl = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] osapi_volume_workers = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] per_volume_size_limit = -1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] periodic_fuzzy_delay = 60 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] periodic_interval = 60 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] public_endpoint = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] publish_errors = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] quota_backup_gigabytes = 1000 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] quota_backups = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] quota_gigabytes = 1000 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] quota_groups = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76463]: INFO cinder.volume.manager [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] quota_snapshots = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] quota_volumes = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] rate_limit_burst = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] rate_limit_except_level = CRITICAL {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] rate_limit_interval = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] reinit_driver_count = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] replication_device = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] report_discard_supported = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] report_interval = 120 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] reservation_clean_interval = 86400 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] reservation_expire = 86400 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] reserved_image_namespaces = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] reserved_percentage = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] rpc_response_timeout = 120 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] run_external_periodic_tasks = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] scst_target_driver = iscsi {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] scst_target_iqn_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_down_time = 720 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] shell_completion = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] snapshot_name_template = snapshot-%s {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] snapshot_same_host = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] split_loggers = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] state_path = /opt/stack/data/cinder {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] storage_availability_zone = nova {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] storage_protocol = iSCSI {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] syslog_log_facility = LOG_USER {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] target_helper = lioadm {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] target_ip_address = 192.168.122.21 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] target_port = 3260 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] target_protocol = iscsi {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] target_secondary_ip_addresses = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] trace_flags = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] transport_url = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] until_refresh = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] use_chap_auth = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] use_default_quota_class = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] use_journal = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] use_json = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] use_multipath_for_image_xfer = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] use_stderr = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] use_syslog = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] verify_glance_signatures = enabled {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_api_class = cinder.volume.api.API {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_backend_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_clear = zero {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_clear_ionice = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_clear_size = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_copy_bps_limit = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_dd_blocksize = 1M {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_name_template = volume-%s {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_service_inithost_offload = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volume_usage_audit_period = month {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] zoning_mode = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:32:20 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_concurrency.disable_process_locking = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.auth_section = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.auth_type = password {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.auth_version = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.cache = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.certfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.include_service_catalog = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.insecure = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.interface = public {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.keyfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_password = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcache_username = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.region_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.service_type = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.backend = dogpile.cache.null {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.backend_argument = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.backend_expiration_time = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.config_prefix = cache.oslo {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.debug_cache_backend = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.enable_retry_client = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.enable_socket_keepalive = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.enabled = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.expiration_time = 600 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.hashclient_retry_attempts = 2 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.memcache_dead_retry = 300 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.memcache_pool_maxsize = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.memcache_sasl_enabled = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.password = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.proxies = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.redis_db = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.redis_server = localhost:6379 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.retry_attempts = 2 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.retry_delay = 0.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.socket_keepalive_count = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.socket_keepalive_idle = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.socket_keepalive_interval = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.socket_timeout = 1.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.tls_allowed_ciphers = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.tls_cafile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.tls_certfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.tls_enabled = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.tls_keyfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cache.username = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] coordination.backend_url = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.asyncio_connection = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.asyncio_slave_connection = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.backend = sqlalchemy {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.connection = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.connection_debug = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.connection_parameters = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.connection_recycle_time = 3600 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.connection_trace = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.db_inc_retry_interval = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.db_max_retries = 20 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.db_max_retry_interval = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.db_retry_interval = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.max_overflow = 50 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.max_pool_size = 5 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.max_retries = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.mysql_wsrep_sync_wait = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.pool_timeout = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.retry_interval = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.slave_connection = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.sqlite_synchronous = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.synchronous_reader = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] database.use_db_reconnect = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.connection_string = messaging:// {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.enabled = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.es_doc_type = notification {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.es_scroll_size = 10000 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.es_scroll_time = 2m {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.filter_error_trace = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.hmac_keys = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.sentinel_service_name = mymaster {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.socket_timeout = 0.1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.trace_requests = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler.trace_sqlalchemy = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler_jaeger.process_tags = {} {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler_jaeger.service_name_prefix = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] profiler_otlp.service_name_prefix = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.enforce_new_defaults = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.policy_default_rule = default {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.policy_file = policy.yaml {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] privsep_osbrick.group = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] privsep_osbrick.helper_command = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] privsep_osbrick.user = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cinder_sys_admin.group = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cinder_sys_admin.helper_command = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] cinder_sys_admin.user = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.auth_section = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.auth_type = password {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.cafile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.certfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.collect_timing = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.insecure = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.keyfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.send_service_user_token = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.split_loggers = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] service_user.timeout = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.auth_section = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.auth_type = password {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.certfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.collect_timing = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.insecure = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.keyfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.region_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.split_loggers = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] glance.timeout = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.backend_availability_zone = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.chap_password = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.chap_username = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.disk_geometry = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack sudo[76511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 18 05:32:20 devstack sudo[76511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.driver_client_cert = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.driver_client_cert_key = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.driver_data_namespace = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.driver_use_ssl = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.extra_capabilities = {} {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.filter_function = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.goodness_function = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.iscsi_target_flags = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.iscsi_write_cache = on {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.iser_helper = tgtadm {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.iser_port = 3260 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.lvm_share_target = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.lvm_type = auto {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.num_shell_tries = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.replication_device = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.report_discard_supported = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.reserved_percentage = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.target_helper = tgtadm {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.target_port = 3260 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.target_protocol = iscsi {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.trace_flags = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.unique_fqdn_network = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.use_chap_auth = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volume_backend_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volume_clear = zero {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volume_clear_ionice = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volume_clear_size = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_reports.file_event_handler = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_reports.log_dir = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.backend_host = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.chap_password = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.chap_username = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.disk_geometry = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.driver_client_cert = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.extra_capabilities = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.filter_function = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.goodness_function = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.iser_helper = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.iser_ip_address = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.iser_port = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.lvm_share_target = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.lvm_type = auto {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.num_shell_tries = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.replication_device = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.report_discard_supported = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.reserved_percentage = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.scst_target_driver = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.storage_protocol = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.target_helper = lioadm {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.target_ip_address = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.target_port = 3260 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.trace_flags = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.use_chap_auth = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volume_clear = zero {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volume_clear_size = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] lvmdriver-1.volumes_dir = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.ssl = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_notifications.driver = [] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_notifications.retry = -1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] key_manager.fixed_key = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.barbican_api_version = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.barbican_endpoint = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.barbican_endpoint_type = public {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.barbican_region_name = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.cafile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.certfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.collect_timing = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.insecure = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.keyfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.number_of_retries = 60 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.retry_delay = 1 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.send_service_user_token = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.split_loggers = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.timeout = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.verify_ssl = True {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican.verify_ssl_path = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican_service_user.auth_section = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican_service_user.auth_type = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican_service_user.cafile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican_service_user.certfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican_service_user.collect_timing = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican_service_user.insecure = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican_service_user.keyfile = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican_service_user.split_loggers = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] barbican_service_user.timeout = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.approle_role_id = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.approle_secret_id = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.auth_method = approle {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.auth_path = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.kv_mountpoint = secret {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.kv_path = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.kv_version = 2 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.namespace = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.root_token_id = **** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.ssl_ca_crt_file = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.timeout = 60.0 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.token_file = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.token_role = None {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.use_ssl = False {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:32:20 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] ******************************************************************************** {{(pid=76316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 18 05:32:20 devstack sudo[76511]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:20 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.382s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:20 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:20 devstack sudo[76667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:32:20 devstack sudo[76667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:21 devstack sudo[76667]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.250s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:32:21 devstack cinder-volume[76463]: INFO cinder.brick.local_dev.lvm [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:21 devstack sudo[76759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:32:21 devstack sudo[76759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:21 devstack sudo[76759]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG cinder.brick.local_dev.lvm [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76463) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:21 devstack sudo[76842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:32:21 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:21 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:21 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:21 devstack sudo[77072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:32:21 devstack sudo[77072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:22 devstack sudo[77072]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:22 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:22 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:22 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:22 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:22 devstack sudo[77076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 18 05:32:22 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:22 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:22 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.356s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:22 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:22 devstack sudo[77159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:32:22 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:22 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:22 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:22 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:22 devstack sudo[77167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:32:22 devstack sudo[77167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:23 devstack sudo[77167]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:23 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:23 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:23 devstack sudo[77235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:32:23 devstack sudo[77235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:23 devstack sudo[77235]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:23 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:23 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:23 devstack sudo[77254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:32:23 devstack sudo[77254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:23 devstack sudo[77254]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:23 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:23 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:23 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:23 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:23 devstack sudo[77258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:32:23 devstack sudo[77258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:24 devstack sudo[77258]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:24 devstack cinder-volume[76463]: INFO cinder.volume.drivers.lvm [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:24 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:32:24 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:24 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.312s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG cinder.volume.drivers.lvm [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Updating volume stats {{(pid=76463) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:24 devstack sudo[77271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:32:24 devstack sudo[77271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:24 devstack sudo[77271]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:24 devstack sudo[77274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:32:24 devstack sudo[77274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:24 devstack sudo[77274]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:24 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:24 devstack sudo[77277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:32:24 devstack sudo[77277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:25 devstack sudo[77277]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:25 devstack sudo[77280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:32:25 devstack sudo[77280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:25 devstack sudo[77280]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:25 devstack cinder-volume[76463]: INFO cinder.volume.driver [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Driver hasn't implemented _init_vendor_properties() Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG cinder.volume.driver [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76463) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG oslo_db.sqlalchemy.engines [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76463) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG dbcounter [-] [76463] Writer thread running {{(pid=76463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG cinder.db.api [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Building query based on filter {{(pid=76463) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG cinder.image.image_utils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76463) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 18 05:32:25 devstack cinder-volume[76463]: INFO cinder.keymgr.migration [None req-d73ad9b7-405c-44b9-942d-b8767a29493f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG cinder.volume.drivers.lvm [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Updating volume stats {{(pid=76463) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:25 devstack sudo[77285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:32:25 devstack sudo[77285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:25 devstack sudo[77285]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:25 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:25 devstack sudo[77289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:32:25 devstack sudo[77289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:26 devstack sudo[77289]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:26 devstack sudo[77292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:32:26 devstack sudo[77292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:26 devstack sudo[77292]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:26 devstack sudo[77297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:32:26 devstack sudo[77297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:26 devstack sudo[77297]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG cinder.manager [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Notifying Schedulers of capabilities ... {{(pid=76463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:32:26 devstack cinder-volume[76463]: INFO cinder.volume.manager [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Driver initialization completed successfully. Jul 18 05:32:26 devstack cinder-volume[76463]: INFO cinder.manager [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Initiating service 2 cleanup Jul 18 05:32:26 devstack cinder-volume[76463]: INFO cinder.manager [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Service 2 cleanup completed. Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG cinder.service [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Creating RPC server for service cinder-volume {{(pid=76463) start /opt/stack/cinder/cinder/service.py:231}} Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG cinder.service [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76463) start /opt/stack/cinder/cinder/service.py:237}} Jul 18 05:32:26 devstack cinder-volume[76463]: INFO cinder.volume.manager [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG cinder.volume.drivers.lvm [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Updating volume stats {{(pid=76463) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:32:26 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:26 devstack sudo[77300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:32:26 devstack sudo[77300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:27 devstack sudo[77300]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:27 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:27 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:27 devstack sudo[77303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:32:27 devstack sudo[77303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:27 devstack sudo[77303]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:27 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:27 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:27 devstack sudo[77306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:32:27 devstack sudo[77306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:27 devstack sudo[77306]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:27 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:27 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:32:27 devstack sudo[77312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:32:27 devstack sudo[77312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:32:27 devstack sudo[77312]: pam_unix(sudo:session): session closed for user root Jul 18 05:32:27 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:32:27 devstack cinder-volume[76463]: INFO cinder.volume.manager [None req-acef5063-8c4a-40ff-badd-e163d9862b10 None None] Driver post RPC initialization completed successfully. Jul 18 05:32:30 devstack cinder-volume[76316]: DEBUG dbcounter [-] [76316] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76316) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:32:37 devstack cinder-volume[76463]: DEBUG dbcounter [-] [76463] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:32:38 devstack cinder-volume[76463]: DEBUG dbcounter [-] [76463] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:33:09 devstack cinder-volume[76463]: DEBUG oslo_service.periodic_task [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running periodic task VolumeManager._thread_info {{(pid=76463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:33:09 devstack cinder-volume[76463]: DEBUG cinder.volume.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] thread count: 6 {{(pid=76463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:33:09 devstack cinder-volume[76463]: DEBUG cinder.volume.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] thread info: [<_MainThread(MainThread, started 132532264276096)>, , , , , ] {{(pid=76463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:34:09 devstack cinder-volume[76463]: DEBUG oslo_service.periodic_task [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:34:09 devstack cinder-volume[76463]: DEBUG cinder.volume.drivers.lvm [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Updating volume stats {{(pid=76463) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:34:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:34:09 devstack sudo[82539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:34:09 devstack sudo[82539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:34:09 devstack sudo[82539]: pam_unix(sudo:session): session closed for user root Jul 18 05:34:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:34:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:34:09 devstack sudo[82542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:34:09 devstack sudo[82542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:34:09 devstack sudo[82542]: pam_unix(sudo:session): session closed for user root Jul 18 05:34:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:34:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:34:09 devstack sudo[82545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:34:09 devstack sudo[82545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:34:09 devstack sudo[82545]: pam_unix(sudo:session): session closed for user root Jul 18 05:34:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:34:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:34:09 devstack sudo[82548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:34:09 devstack sudo[82548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:34:10 devstack sudo[82548]: pam_unix(sudo:session): session closed for user root Jul 18 05:34:10 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:34:10 devstack cinder-volume[76463]: DEBUG cinder.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Notifying Schedulers of capabilities ... {{(pid=76463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:34:10 devstack cinder-volume[76463]: DEBUG oslo_service.periodic_task [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running periodic task VolumeManager._thread_info {{(pid=76463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:34:10 devstack cinder-volume[76463]: DEBUG cinder.volume.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] thread count: 6 {{(pid=76463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:34:10 devstack cinder-volume[76463]: DEBUG cinder.volume.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] thread info: [<_MainThread(MainThread, started 132532264276096)>, , , , , ] {{(pid=76463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:34:38 devstack cinder-volume[76463]: DEBUG dbcounter [-] [76463] Writing DB stats cinder:SELECT=1 {{(pid=76463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:34:38 devstack cinder-volume[76463]: DEBUG dbcounter [-] [76463] Writing DB stats cinder:UPDATE=1 {{(pid=76463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:35:09 devstack cinder-volume[76463]: DEBUG oslo_service.periodic_task [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:35:09 devstack cinder-volume[76463]: DEBUG cinder.volume.drivers.lvm [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Updating volume stats {{(pid=76463) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:35:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:35:09 devstack sudo[84126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:35:09 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:35:09 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root Jul 18 05:35:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:35:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:35:09 devstack sudo[84131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:35:09 devstack sudo[84131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:35:09 devstack sudo[84131]: pam_unix(sudo:session): session closed for user root Jul 18 05:35:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:35:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:35:09 devstack sudo[84136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:35:09 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:35:09 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root Jul 18 05:35:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:35:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:35:09 devstack sudo[84139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:35:09 devstack sudo[84139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:35:10 devstack sudo[84139]: pam_unix(sudo:session): session closed for user root Jul 18 05:35:10 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:35:10 devstack cinder-volume[76463]: DEBUG cinder.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Notifying Schedulers of capabilities ... {{(pid=76463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:35:10 devstack cinder-volume[76463]: DEBUG oslo_service.periodic_task [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running periodic task VolumeManager._thread_info {{(pid=76463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:35:10 devstack cinder-volume[76463]: DEBUG cinder.volume.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] thread count: 6 {{(pid=76463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:35:10 devstack cinder-volume[76463]: DEBUG cinder.volume.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] thread info: [<_MainThread(MainThread, started 132532264276096)>, , , , , ] {{(pid=76463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:36:09 devstack cinder-volume[76463]: DEBUG oslo_service.periodic_task [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:36:09 devstack cinder-volume[76463]: DEBUG cinder.volume.drivers.lvm [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Updating volume stats {{(pid=76463) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:36:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:36:09 devstack sudo[85545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:36:09 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:36:09 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root Jul 18 05:36:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:36:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:36:09 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:36:09 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:36:09 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Jul 18 05:36:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:36:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:36:09 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:36:09 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:36:09 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Jul 18 05:36:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:36:09 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:36:09 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:36:09 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:36:10 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Jul 18 05:36:10 devstack cinder-volume[76463]: DEBUG oslo_concurrency.processutils [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:36:10 devstack cinder-volume[76463]: DEBUG cinder.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Notifying Schedulers of capabilities ... {{(pid=76463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:36:10 devstack cinder-volume[76463]: DEBUG oslo_service.periodic_task [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] Running periodic task VolumeManager._thread_info {{(pid=76463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:36:10 devstack cinder-volume[76463]: DEBUG cinder.volume.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] thread count: 6 {{(pid=76463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:36:10 devstack cinder-volume[76463]: DEBUG cinder.volume.manager [None req-3de71c60-4a99-4828-9643-80598c819b67 None None] thread info: [<_MainThread(MainThread, started 132532264276096)>, , , , , ] {{(pid=76463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:36:38 devstack cinder-volume[76463]: DEBUG dbcounter [-] [76463] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:36:55 devstack cinder-volume[76316]: INFO oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Caught SIGTERM, stopping children Jul 18 05:36:55 devstack cinder-volume[76316]: DEBUG oslo_concurrency.lockutils [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Acquiring lock "singleton_lock" {{(pid=76316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:36:55 devstack cinder-volume[76316]: DEBUG oslo_concurrency.lockutils [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Acquired lock "singleton_lock" {{(pid=76316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:36:55 devstack cinder-volume[76316]: DEBUG oslo_concurrency.lockutils [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Releasing lock "singleton_lock" {{(pid=76316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:36:55 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Stop services. {{(pid=76316) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 18 05:36:55 devstack cinder-volume[76316]: DEBUG oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Killing children. {{(pid=76316) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 18 05:36:55 devstack cinder-volume[76316]: INFO oslo_service.backend._eventlet.service [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Waiting on 1 children to exit Jul 18 05:37:00 devstack cinder-volume[76463]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 18 05:37:00 devstack cinder-volume[86559]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 18 05:37:00 devstack cinder-volume[86559]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 18 05:37:00 devstack cinder-volume[86559]: we strongly recommend against using it for new projects. Jul 18 05:37:00 devstack cinder-volume[86559]: If you are already using Eventlet, we recommend migrating to a different Jul 18 05:37:00 devstack cinder-volume[86559]: framework. For more detail see Jul 18 05:37:00 devstack cinder-volume[86559]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 18 05:37:00 devstack cinder-volume[86559]: import eventlet # noqa Jul 18 05:37:01 devstack cinder-volume[76463]: DEBUG oslo_concurrency.lockutils [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Acquiring lock "singleton_lock" {{(pid=76463) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:37:01 devstack cinder-volume[76463]: DEBUG oslo_concurrency.lockutils [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Acquired lock "singleton_lock" {{(pid=76463) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:37:01 devstack cinder-volume[76463]: DEBUG oslo_concurrency.lockutils [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Releasing lock "singleton_lock" {{(pid=76463) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:37:01 devstack cinder-volume[76463]: WARNING amqp [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 18 05:37:01 devstack cinder-volume[76463]: WARNING amqp [None req-00314311-7b3b-4222-9be8-9bbc1f3d3b78 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 18 05:37:02 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:37:02 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:37:02 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:37:03 devstack cinder-volume[86559]: INFO dbcounter [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Registered counter for database cinder Jul 18 05:37:03 devstack cinder-volume[86559]: DEBUG oslo_db.sqlalchemy.engines [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86559) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:37:03 devstack cinder-volume[86559]: DEBUG dbcounter [-] [86559] Writer thread running {{(pid=86559) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:37:03 devstack cinder-volume[86559]: INFO cinder.rpc [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 18 05:37:03 devstack cinder-volume[86559]: INFO cinder.rpc [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 18 05:37:03 devstack cinder-volume[86559]: DEBUG oslo_db.sqlalchemy.engines [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86559) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:37:03 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Determined volume DB was empty at startup. Jul 18 05:37:03 devstack cinder-volume[86559]: DEBUG cinder.volume.manager [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86559) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 18 05:37:03 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 18 05:37:03 devstack cinder-volume[86559]: WARNING stevedore.named [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 18 05:37:03 devstack cinder-volume[86559]: WARNING castellan.key_manager [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:37:03 devstack cinder-volume[86559]: WARNING cinder.keymgr.conf_key_mgr [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:37:04 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_db.sqlalchemy.engines [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86559) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:37:04 devstack cinder-volume[86559]: INFO oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Starting 1 workers Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Started child 86784 {{(pid=86559) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Full set of CONF: {{(pid=86559) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] ******************************************************************************** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Configuration options gathered from: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] ================================================================================ {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] allow_availability_zone_fallback = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] allow_compression_on_image_upload = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] allowed_direct_url_schemes = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] api_rate_limit = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] auth_strategy = keystone {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_availability_zone = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_host = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_stats_polling_interval = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backup_api_class = cinder.backup.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backup_name_template = backup-%s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backup_use_same_host = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backup_use_temp_snapshot = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] chap_password = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] chap_username = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86784]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cinder_internal_tenant_project_id = d838faffc97147d4afe348d3b4eb9b10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cinder_internal_tenant_user_id = b19d351167334f239b2ff27067a63089 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cluster = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] compression_format = gzip {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] compute_api_class = cinder.compute.nova.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] config_dir = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] config_source = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] control_exchange = openstack {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] debug = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] default_availability_zone = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] default_group_type = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] default_volume_type = QuobyteHD {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] disk_geometry = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] driver_client_cert = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] driver_client_cert_key = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] driver_data_namespace = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] driver_ssl_cert_path = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] driver_ssl_cert_verify = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] driver_use_ssl = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] enable_new_services = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] enable_unsupported_driver = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] enabled_backends = ['QuobyteHD'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] enforce_multipath_for_image_xfer = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] filter_function = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_api_insecure = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_api_ssl_compression = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_ca_certificates_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_catalog_info = image:glance:publicURL {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_keyfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_num_retries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance_request_timeout = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] goodness_function = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] graceful_shutdown_timeout = 5 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] group_api_class = cinder.group.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] host = devstack {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_compress_on_upload = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_conversion_address_space_limit = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_conversion_cpu_limit = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_conversion_disable = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_upload_use_cinder_backend = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_upload_use_internal_tenant = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_volume_cache_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_volume_cache_max_count = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] image_volume_cache_max_size_gb = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] init_host_max_objects_retrieval = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] instance_format = [instance: %(uuid)s] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] iscsi_target_flags = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] iscsi_write_cache = on {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] iser_helper = tgtadm {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] iser_ip_address = 192.168.122.21 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] iser_port = 3260 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] log_color = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] log_config_append = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] log_dir = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] log_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] log_options = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] log_rotate_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] log_rotate_interval_type = days {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] log_rotation_type = none {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] max_age = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] max_logfile_count = 30 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] max_logfile_size_mb = 200 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] max_over_subscription_ratio = 20.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] message_reap_interval = 86400 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] message_ttl = 2592000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] migration_create_volume_timeout_secs = 300 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] monkey_patch = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] monkey_patch_modules = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] my_ip = 192.168.122.21 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] no_snapshot_gb_quota = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] num_iser_scan_tries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] num_shell_tries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] num_volume_device_scan_tries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] nvmeof_conn_info_version = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] nvmet_ns_id = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] nvmet_port_id = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] osapi_max_limit = 1000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] osapi_volume_ext_list = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] osapi_volume_listen_port = 8776 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] osapi_volume_use_ssl = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] osapi_volume_workers = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] per_volume_size_limit = -1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] periodic_fuzzy_delay = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] periodic_interval = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] public_endpoint = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] publish_errors = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] quota_backup_gigabytes = 1000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] quota_backups = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] quota_gigabytes = 1000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] quota_groups = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] quota_snapshots = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] quota_volumes = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] rate_limit_burst = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] rate_limit_except_level = CRITICAL {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] rate_limit_interval = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] reinit_driver_count = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] replication_device = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] report_discard_supported = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] report_interval = 120 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] reservation_clean_interval = 86400 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] reservation_expire = 86400 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] reserved_image_namespaces = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] reserved_percentage = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] rpc_response_timeout = 120 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] run_external_periodic_tasks = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] scst_target_driver = iscsi {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] scst_target_iqn_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_down_time = 720 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] shell_completion = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] snapshot_name_template = snapshot-%s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] split_loggers = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] state_path = /opt/stack/data/cinder {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] storage_availability_zone = nova {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] storage_protocol = iSCSI {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] syslog_log_facility = LOG_USER {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] target_helper = lioadm {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] target_ip_address = 192.168.122.21 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] target_port = 3260 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] target_protocol = iscsi {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] target_secondary_ip_addresses = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] trace_flags = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] transport_url = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] until_refresh = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] use_chap_auth = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] use_default_quota_class = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] use_journal = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] use_json = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] use_multipath_for_image_xfer = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] use_stderr = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] use_syslog = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] verify_glance_signatures = enabled {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_api_class = cinder.volume.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_backend_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_clear = zero {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_clear_ionice = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_clear_size = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_copy_bps_limit = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_dd_blocksize = 1M {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_name_template = volume-%s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_service_inithost_offload = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volume_usage_audit_period = month {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] zoning_mode = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:04 devstack cinder-volume[86784]: INFO cinder.volume.manager [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Starting volume driver QuobyteDriver (1.2) Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_concurrency.disable_process_locking = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.remotefs [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86784) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.auth_section = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.auth_type = password {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.auth_version = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.cache = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.include_service_catalog = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.insecure = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.interface = public {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.keyfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_password = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcache_username = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.region_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.service_type = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.backend = dogpile.cache.null {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.backend_argument = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.backend_expiration_time = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.config_prefix = cache.oslo {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.debug_cache_backend = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.enable_retry_client = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.enable_socket_keepalive = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.expiration_time = 600 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.hashclient_retry_attempts = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.memcache_dead_retry = 300 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.memcache_pool_maxsize = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.memcache_sasl_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.password = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.proxies = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.redis_db = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.redis_server = localhost:6379 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.retry_attempts = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.retry_delay = 0.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.socket_keepalive_count = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.socket_keepalive_idle = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.socket_keepalive_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.socket_timeout = 1.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.tls_allowed_ciphers = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.tls_cafile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.tls_certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.tls_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.tls_keyfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cache.username = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] coordination.backend_url = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.asyncio_connection = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.asyncio_slave_connection = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.backend = sqlalchemy {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.connection = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.connection_debug = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.connection_parameters = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.connection_recycle_time = 3600 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.connection_trace = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.db_inc_retry_interval = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.db_max_retries = 20 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.db_max_retry_interval = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.db_retry_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.max_overflow = 50 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.max_pool_size = 5 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.max_retries = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.mysql_wsrep_sync_wait = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.pool_timeout = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.retry_interval = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.slave_connection = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.sqlite_synchronous = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.synchronous_reader = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] database.use_db_reconnect = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.connection_string = messaging:// {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.es_doc_type = notification {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.es_scroll_size = 10000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.es_scroll_time = 2m {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.filter_error_trace = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.hmac_keys = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.sentinel_service_name = mymaster {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.socket_timeout = 0.1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.trace_requests = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler.trace_sqlalchemy = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler_jaeger.process_tags = {} {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler_jaeger.service_name_prefix = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] profiler_otlp.service_name_prefix = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.enforce_new_defaults = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.policy_default_rule = default {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.policy_file = policy.yaml {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] privsep_osbrick.group = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] privsep_osbrick.helper_command = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] privsep_osbrick.user = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cinder_sys_admin.group = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cinder_sys_admin.helper_command = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] cinder_sys_admin.user = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.auth_section = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.auth_type = password {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.cafile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.collect_timing = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.insecure = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.keyfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.send_service_user_token = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.split_loggers = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] service_user.timeout = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.auth_section = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.auth_type = password {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.collect_timing = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.insecure = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.keyfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.region_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.split_loggers = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] glance.timeout = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.backend_availability_zone = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.chap_password = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.chap_username = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.disk_geometry = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.driver_client_cert = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.driver_client_cert_key = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.driver_data_namespace = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.driver_use_ssl = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.extra_capabilities = {} {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.filter_function = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.goodness_function = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.iscsi_target_flags = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.iscsi_write_cache = on {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.iser_helper = tgtadm {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.iser_port = 3260 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_host = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_login = admin {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_mount_options = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_password = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_private_key = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_share_path = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.num_shell_tries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.quobyte_volume_url = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.replication_device = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.report_discard_supported = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.reserved_percentage = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.target_helper = tgtadm {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.target_port = 3260 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.target_protocol = iscsi {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.trace_flags = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.unique_fqdn_network = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.use_chap_auth = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.volume_backend_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.volume_clear = zero {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.volume_clear_ionice = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.volume_clear_size = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_reports.file_event_handler = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_reports.log_dir = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.backend_availability_zone = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.backend_host = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.chap_password = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.chap_username = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.chiscsi_conf = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.disk_geometry = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.driver_client_cert = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.driver_data_namespace = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.driver_use_ssl = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.extra_capabilities = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.filter_function = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.goodness_function = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.iser_helper = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.iser_ip_address = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.iser_port = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.iser_target_prefix = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_host = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_login = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_mount_options = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_password = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_private_key = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_share_path = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_ssh_port = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.num_shell_tries = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.nvmet_port_id = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.replication_device = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.report_discard_supported = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.reserved_percentage = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.scst_target_driver = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.storage_protocol = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.target_helper = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.target_ip_address = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.target_port = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.target_prefix = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.target_protocol = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.trace_flags = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.use_chap_auth = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.volume_clear = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.volume_clear_size = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] QuobyteHD.volumes_dir = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.ssl = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_notifications.driver = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_notifications.retry = -1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] key_manager.fixed_key = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.barbican_api_version = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.barbican_endpoint = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.barbican_endpoint_type = public {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.barbican_region_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.cafile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.collect_timing = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.insecure = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.keyfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.number_of_retries = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.retry_delay = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.send_service_user_token = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.split_loggers = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.timeout = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.verify_ssl = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican.verify_ssl_path = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican_service_user.auth_section = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican_service_user.auth_type = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican_service_user.cafile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican_service_user.certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican_service_user.collect_timing = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican_service_user.insecure = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican_service_user.keyfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican_service_user.split_loggers = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] barbican_service_user.timeout = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.approle_role_id = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.approle_secret_id = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.auth_method = approle {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.auth_path = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.kv_mountpoint = secret {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.kv_path = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.kv_version = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.namespace = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.root_token_id = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.ssl_ca_crt_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.timeout = 60.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.token_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.token_role = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.use_ssl = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:04 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] ******************************************************************************** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86784) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 18 05:37:04 devstack cinder-volume[86784]: WARNING cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 18 05:37:04 devstack cinder-volume[86784]: WARNING cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Running cmd (subprocess): mount.quobyte {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:04 devstack quobyte-client[86789]: Reading configuration file: /etc/quobyte/client.cfg Jul 18 05:37:04 devstack quobyte-client[86789]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] CMD "mount.quobyte" returned: 1 in 0.124s {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=86784) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:37:04 devstack cinder-volume[86784]: INFO cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 ... Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc -c /etc/quobyte/client-cinder.cfg {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:04 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc -c /etc/quobyte/client-cinder.cfg Jul 18 05:37:04 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:37:04 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.377s {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:04 devstack cinder-volume[86784]: INFO cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 succeeded Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=86784) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.387s {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:37:04 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:04 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:37:04 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:37:05 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.247s {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:05 devstack cinder-volume[86784]: INFO cinder.volume.driver [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Driver hasn't implemented _init_vendor_properties() Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.volume.driver [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86784) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_db.sqlalchemy.engines [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG dbcounter [-] [86784] Writer thread running {{(pid=86784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.db.api [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Building query based on filter {{(pid=86784) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.image.image_utils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86784) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 18 05:37:05 devstack cinder-volume[86784]: INFO cinder.keymgr.migration [None req-bade7463-29e8-48d0-aafd-77d34c4d108f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=86784) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=86784) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:05 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:37:05 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:37:05 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.245s {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.manager [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Notifying Schedulers of capabilities ... {{(pid=86784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:37:05 devstack cinder-volume[86784]: INFO cinder.volume.manager [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Driver initialization completed successfully. Jul 18 05:37:05 devstack cinder-volume[86784]: INFO cinder.manager [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Initiating service 3 cleanup Jul 18 05:37:05 devstack cinder-volume[86784]: INFO cinder.manager [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Service 3 cleanup completed. Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.service [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Creating RPC server for service cinder-volume {{(pid=86784) start /opt/stack/cinder/cinder/service.py:231}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.service [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86784) start /opt/stack/cinder/cinder/service.py:237}} Jul 18 05:37:05 devstack cinder-volume[86784]: INFO cinder.volume.manager [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=86784) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.quobyte [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=86784) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:05 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:37:05 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:37:05 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Jul 18 05:37:05 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.265s {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:05 devstack cinder-volume[86784]: INFO cinder.volume.manager [None req-b8b26dd4-4ed3-43de-a3ca-c9e80292eb49 None None] Driver post RPC initialization completed successfully. Jul 18 05:37:10 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-ce2ee465-a61b-4b4c-a7e5-81bda060c57d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:37:10 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-ce2ee465-a61b-4b4c-a7e5-81bda060c57d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:37:10 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.quobyte [None req-ce2ee465-a61b-4b4c-a7e5-81bda060c57d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=86784) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:37:10 devstack cinder-volume[86784]: DEBUG cinder.volume.drivers.quobyte [None req-ce2ee465-a61b-4b4c-a7e5-81bda060c57d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=86784) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:37:10 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-ce2ee465-a61b-4b4c-a7e5-81bda060c57d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86784) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:37:10 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-ce2ee465-a61b-4b4c-a7e5-81bda060c57d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:10 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:37:10 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:37:10 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Jul 18 05:37:10 devstack cinder-volume[86784]: DEBUG oslo_concurrency.processutils [None req-ce2ee465-a61b-4b4c-a7e5-81bda060c57d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.250s {{(pid=86784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:10 devstack cinder-volume[86784]: DEBUG cinder.manager [None req-ce2ee465-a61b-4b4c-a7e5-81bda060c57d None None] Notifying Schedulers of capabilities ... {{(pid=86784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:37:11 devstack cinder-volume[86559]: INFO oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Caught SIGTERM, stopping children Jul 18 05:37:11 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Acquiring lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:37:11 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Acquired lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:37:11 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Releasing lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:37:11 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Stop services. {{(pid=86559) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 18 05:37:11 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Killing children. {{(pid=86559) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 18 05:37:11 devstack cinder-volume[86559]: INFO oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Waiting on 1 children to exit Jul 18 05:37:13 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Acquiring lock "singleton_lock" {{(pid=86784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:37:13 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Acquired lock "singleton_lock" {{(pid=86784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:37:13 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Releasing lock "singleton_lock" {{(pid=86784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:37:13 devstack cinder-volume[86784]: WARNING amqp [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 18 05:37:13 devstack cinder-volume[86784]: WARNING amqp [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 18 05:37:14 devstack cinder-volume[86559]: INFO oslo_service.backend._eventlet.service [None req-3e1bb5a9-0420-46b1-9406-9981aaa7d2d6 None None] Child 86784 exited with status 0 Jul 18 05:37:14 devstack cinder-volume[87184]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 18 05:37:14 devstack cinder-volume[87184]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 18 05:37:14 devstack cinder-volume[87184]: we strongly recommend against using it for new projects. Jul 18 05:37:14 devstack cinder-volume[87184]: If you are already using Eventlet, we recommend migrating to a different Jul 18 05:37:14 devstack cinder-volume[87184]: framework. For more detail see Jul 18 05:37:14 devstack cinder-volume[87184]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 18 05:37:14 devstack cinder-volume[87184]: import eventlet # noqa Jul 18 05:37:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:37:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:37:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:37:18 devstack cinder-volume[87184]: INFO dbcounter [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Registered counter for database cinder Jul 18 05:37:18 devstack cinder-volume[87184]: DEBUG oslo_db.sqlalchemy.engines [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:37:18 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writer thread running {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:37:18 devstack cinder-volume[87184]: INFO cinder.rpc [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 18 05:37:18 devstack cinder-volume[87184]: INFO cinder.rpc [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 18 05:37:18 devstack cinder-volume[87184]: DEBUG oslo_db.sqlalchemy.engines [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:37:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Determined volume DB was empty at startup. Jul 18 05:37:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87184) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 18 05:37:18 devstack cinder-volume[87184]: WARNING stevedore.named [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 18 05:37:18 devstack cinder-volume[87184]: WARNING castellan.key_manager [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:37:18 devstack cinder-volume[87184]: WARNING cinder.keymgr.conf_key_mgr [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:37:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_db.sqlalchemy.engines [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:37:19 devstack cinder-volume[87184]: INFO oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Starting 1 workers Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Started child 87497 {{(pid=87184) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Full set of CONF: {{(pid=87184) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] ******************************************************************************** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] Configuration options gathered from: {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 18 05:37:19 devstack cinder-volume[87497]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] ================================================================================ {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] allow_availability_zone_fallback = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] allow_compression_on_image_upload = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] allowed_direct_url_schemes = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] api_rate_limit = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] auth_strategy = keystone {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_availability_zone = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_host = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_stats_polling_interval = 60 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backup_api_class = cinder.backup.api.API {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backup_name_template = backup-%s {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backup_use_same_host = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backup_use_temp_snapshot = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] chap_password = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] chap_username = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cinder_internal_tenant_project_id = d838faffc97147d4afe348d3b4eb9b10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cinder_internal_tenant_user_id = b19d351167334f239b2ff27067a63089 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cluster = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] compression_format = gzip {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] compute_api_class = cinder.compute.nova.API {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] config_dir = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] config_source = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] control_exchange = openstack {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] debug = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] default_availability_zone = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] default_group_type = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] default_volume_type = QuobyteHD {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] disk_geometry = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] driver_client_cert = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] driver_client_cert_key = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] driver_data_namespace = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] driver_ssl_cert_path = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] driver_ssl_cert_verify = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] driver_use_ssl = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] enable_new_services = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] enable_unsupported_driver = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] enabled_backends = ['QuobyteHD'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] enforce_multipath_for_image_xfer = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] filter_function = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_api_insecure = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_api_ssl_compression = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_ca_certificates_file = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_catalog_info = image:glance:publicURL {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_certfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_keyfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_num_retries = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance_request_timeout = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] goodness_function = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] graceful_shutdown_timeout = 5 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] group_api_class = cinder.group.api.API {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] host = devstack {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_compress_on_upload = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_conversion_address_space_limit = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_conversion_cpu_limit = 60 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_conversion_disable = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_upload_use_cinder_backend = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_upload_use_internal_tenant = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_volume_cache_enabled = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_volume_cache_max_count = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] image_volume_cache_max_size_gb = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] init_host_max_objects_retrieval = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] instance_format = [instance: %(uuid)s] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] iscsi_target_flags = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] iscsi_write_cache = on {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] iser_helper = tgtadm {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] iser_ip_address = 192.168.122.21 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] iser_port = 3260 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] log_color = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] log_config_append = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] log_dir = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] log_file = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] log_options = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] log_rotate_interval = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] log_rotate_interval_type = days {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] log_rotation_type = none {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] max_age = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] max_logfile_count = 30 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] max_logfile_size_mb = 200 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] max_over_subscription_ratio = 20.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] message_reap_interval = 86400 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] message_ttl = 2592000 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] migration_create_volume_timeout_secs = 300 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] monkey_patch = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] monkey_patch_modules = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] my_ip = 192.168.122.21 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] no_snapshot_gb_quota = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] num_iser_scan_tries = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] num_shell_tries = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] num_volume_device_scan_tries = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] nvmeof_conn_info_version = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] nvmet_ns_id = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] nvmet_port_id = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] osapi_max_limit = 1000 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] osapi_volume_ext_list = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Starting volume driver QuobyteDriver (1.2) Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] osapi_volume_listen_port = 8776 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] osapi_volume_use_ssl = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] osapi_volume_workers = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] per_volume_size_limit = -1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] periodic_fuzzy_delay = 60 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] periodic_interval = 60 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87497) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] public_endpoint = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] publish_errors = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] quota_backup_gigabytes = 1000 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] quota_backups = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] quota_gigabytes = 1000 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] quota_groups = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] quota_snapshots = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] quota_volumes = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] rate_limit_burst = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] rate_limit_except_level = CRITICAL {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] rate_limit_interval = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] reinit_driver_count = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] replication_device = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] report_discard_supported = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] report_interval = 120 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] reservation_clean_interval = 86400 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] reservation_expire = 86400 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] reserved_image_namespaces = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] reserved_percentage = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] rpc_response_timeout = 120 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] run_external_periodic_tasks = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] scst_target_driver = iscsi {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] scst_target_iqn_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_down_time = 720 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] shell_completion = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] snapshot_name_template = snapshot-%s {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] split_loggers = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] state_path = /opt/stack/data/cinder {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] storage_availability_zone = nova {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] storage_protocol = iSCSI {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] syslog_log_facility = LOG_USER {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] target_helper = lioadm {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] target_ip_address = 192.168.122.21 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] target_port = 3260 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] target_protocol = iscsi {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] target_secondary_ip_addresses = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] trace_flags = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] transport_url = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] until_refresh = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] use_chap_auth = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] use_default_quota_class = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] use_journal = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] use_json = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] use_multipath_for_image_xfer = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] use_stderr = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] use_syslog = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] verify_glance_signatures = enabled {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_api_class = cinder.volume.api.API {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_backend_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_clear = zero {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_clear_ionice = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_clear_size = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_copy_bps_limit = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_dd_blocksize = 1M {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_name_template = volume-%s {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_service_inithost_offload = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volume_usage_audit_period = month {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] zoning_mode = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_concurrency.disable_process_locking = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.auth_section = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.auth_type = password {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.auth_version = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.cache = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.certfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.include_service_catalog = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.insecure = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.interface = public {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.keyfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_password = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcache_username = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.region_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.service_type = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.backend = dogpile.cache.null {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.backend_argument = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.backend_expiration_time = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.config_prefix = cache.oslo {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.debug_cache_backend = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.enable_retry_client = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.enable_socket_keepalive = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.enabled = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.expiration_time = 600 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.hashclient_retry_attempts = 2 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.memcache_dead_retry = 300 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.memcache_pool_maxsize = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.memcache_sasl_enabled = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.password = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.proxies = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.redis_db = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.redis_server = localhost:6379 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87497) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 18 05:37:19 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.quobyte [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 18 05:37:19 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.quobyte [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.retry_attempts = 2 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Running cmd (subprocess): mount.quobyte {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.retry_delay = 0.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.socket_keepalive_count = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.socket_keepalive_idle = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.socket_keepalive_interval = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.socket_timeout = 1.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.tls_allowed_ciphers = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.tls_cafile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.tls_certfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.tls_enabled = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.tls_keyfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cache.username = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] coordination.backend_url = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.asyncio_connection = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.asyncio_slave_connection = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.backend = sqlalchemy {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.connection = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.connection_debug = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.connection_parameters = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.connection_recycle_time = 3600 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.connection_trace = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.db_inc_retry_interval = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.db_max_retries = 20 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.db_max_retry_interval = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.db_retry_interval = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.max_overflow = 50 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.max_pool_size = 5 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.max_retries = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.mysql_wsrep_sync_wait = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.pool_timeout = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.retry_interval = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.slave_connection = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.sqlite_synchronous = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.synchronous_reader = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] database.use_db_reconnect = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.connection_string = messaging:// {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.enabled = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.es_doc_type = notification {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.es_scroll_size = 10000 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.es_scroll_time = 2m {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.filter_error_trace = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.hmac_keys = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.sentinel_service_name = mymaster {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.socket_timeout = 0.1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.trace_requests = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler.trace_sqlalchemy = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler_jaeger.process_tags = {} {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler_jaeger.service_name_prefix = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] profiler_otlp.service_name_prefix = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.enforce_new_defaults = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.policy_default_rule = default {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.policy_file = policy.yaml {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] privsep_osbrick.group = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] privsep_osbrick.helper_command = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] privsep_osbrick.user = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack quobyte-client[87504]: Reading configuration file: /etc/quobyte/client.cfg Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cinder_sys_admin.group = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cinder_sys_admin.helper_command = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack quobyte-client[87504]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] cinder_sys_admin.user = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.auth_section = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.auth_type = password {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.cafile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.certfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.collect_timing = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.insecure = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] CMD "mount.quobyte" returned: 1 in 0.106s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.keyfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.send_service_user_token = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.split_loggers = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] service_user.timeout = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.auth_section = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.auth_type = password {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.certfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.collect_timing = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.insecure = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.keyfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.region_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.split_loggers = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] glance.timeout = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.backend_availability_zone = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.chap_password = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.chap_username = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.disk_geometry = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:37:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.driver_client_cert = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.driver_client_cert_key = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.driver_data_namespace = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.driver_use_ssl = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.extra_capabilities = {} {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.filter_function = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.goodness_function = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.iscsi_target_flags = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.iscsi_write_cache = on {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.iser_helper = tgtadm {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.iser_port = 3260 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_host = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_login = admin {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_mount_options = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_password = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_private_key = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_share_path = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.num_shell_tries = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.quobyte_volume_url = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.replication_device = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.report_discard_supported = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.reserved_percentage = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.target_helper = tgtadm {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.target_port = 3260 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.target_protocol = iscsi {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.trace_flags = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.unique_fqdn_network = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.use_chap_auth = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.volume_backend_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.volume_clear = zero {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.volume_clear_ionice = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.volume_clear_size = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_reports.file_event_handler = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_reports.log_dir = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.backend_availability_zone = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.backend_host = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.chap_password = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.chap_username = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.chiscsi_conf = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.disk_geometry = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.driver_client_cert = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.driver_data_namespace = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.driver_use_ssl = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.extra_capabilities = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.filter_function = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.goodness_function = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.iser_helper = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.iser_ip_address = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.iser_port = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.iser_target_prefix = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_host = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_login = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_mount_options = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_password = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_private_key = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_share_path = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_ssh_port = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.num_shell_tries = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.nvmet_port_id = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.replication_device = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.report_discard_supported = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.reserved_percentage = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.scst_target_driver = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.storage_protocol = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.target_helper = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.target_ip_address = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.target_port = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.target_prefix = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.target_protocol = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.trace_flags = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.use_chap_auth = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.volume_clear = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.volume_clear_size = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] QuobyteHD.volumes_dir = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.ssl = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_notifications.driver = [] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_notifications.retry = -1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] key_manager.fixed_key = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.barbican_api_version = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.barbican_endpoint = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.barbican_endpoint_type = public {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.barbican_region_name = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.cafile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.certfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.collect_timing = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.insecure = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.keyfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.number_of_retries = 60 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.retry_delay = 1 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.send_service_user_token = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.split_loggers = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.timeout = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.verify_ssl = True {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican.verify_ssl_path = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican_service_user.auth_section = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican_service_user.auth_type = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican_service_user.cafile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican_service_user.certfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican_service_user.collect_timing = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican_service_user.insecure = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican_service_user.keyfile = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican_service_user.split_loggers = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] barbican_service_user.timeout = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.approle_role_id = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.approle_secret_id = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.auth_method = approle {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.auth_path = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.kv_mountpoint = secret {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.kv_path = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.kv_version = 2 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.namespace = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.root_token_id = **** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.ssl_ca_crt_file = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.timeout = 60.0 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.token_file = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.token_role = None {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.use_ssl = False {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:37:19 devstack cinder-volume[87184]: DEBUG oslo_service.backend._eventlet.service [None req-982e8703-bd65-4d3b-b6d7-90334d67e5c4 None None] ******************************************************************************** {{(pid=87184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 18 05:37:20 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.469s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:20 devstack cinder-volume[87497]: INFO cinder.volume.driver [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Driver hasn't implemented _init_vendor_properties() Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.volume.driver [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87497) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_db.sqlalchemy.engines [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87497) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writer thread running {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.db.api [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Building query based on filter {{(pid=87497) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87497) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:20 devstack cinder-volume[87497]: INFO cinder.keymgr.migration [None req-f4383733-d6e7-4ec4-954c-7b84ce944cff None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 18 05:37:20 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:37:20 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:37:20 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.271s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:37:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Driver initialization completed successfully. Jul 18 05:37:20 devstack cinder-volume[87497]: INFO cinder.manager [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Initiating service 3 cleanup Jul 18 05:37:20 devstack cinder-volume[87497]: INFO cinder.manager [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Service 3 cleanup completed. Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.service [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Creating RPC server for service cinder-volume {{(pid=87497) start /opt/stack/cinder/cinder/service.py:231}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.service [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87497) start /opt/stack/cinder/cinder/service.py:237}} Jul 18 05:37:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:37:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:37:20 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:37:20 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:37:21 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Jul 18 05:37:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.253s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:37:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0604797e-7a41-435c-998e-d3fc918d15bf None None] Driver post RPC initialization completed successfully. Jul 18 05:37:29 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:37:30 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:37:31 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=3 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:38:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:38:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 6 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:38:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Flow 'volume_create_manager' (bf97c6bb-8525-444b-bb47-079ad8e3b0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f679899-c1e1-43ac-97df-740931362549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f679899-c1e1-43ac-97df-740931362549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-239495042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03754c5-cc46-4492-a1ba-3c946d3c81a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfb882b275c4d87a42fbc2dd78c9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:38:21Z,use_quota=True,user_id='20fe8d09777f4d5b96e7bc1ba6fbf97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a36767-52f7-4479-83f1-d02424eafd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a36767-52f7-4479-83f1-d02424eafd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2852dc4-4af4-42f3-9da4-9332276a9087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2852dc4-4af4-42f3-9da4-9332276a9087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03754c5-cc46-4492-a1ba-3c946d3c81a4', 'volume_name': 'volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de9ab85-0eac-48c8-a01c-96288934bd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de9ab85-0eac-48c8-a01c-96288934bd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f93a7d2-f990-4e5d-b11d-3b4735426536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Volume b03754c5-cc46-4492-a1ba-3c946d3c81a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4', 'volume_size': 1} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-239495042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03754c5-cc46-4492-a1ba-3c946d3c81a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfb882b275c4d87a42fbc2dd78c9972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:38:21Z,use_quota=True,user_id='20fe8d09777f4d5b96e7bc1ba6fbf97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Creating volume b03754c5-cc46-4492-a1ba-3c946d3c81a4 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:38:21 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:38:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:21 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 1073741824 Jul 18 05:38:21 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:22 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 1073741824" returned: 0 in 0.648s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:22 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 Jul 18 05:38:22 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:22 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4" returned: 0 in 0.319s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:38:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:38:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f93a7d2-f990-4e5d-b11d-3b4735426536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1222f9eb-0580-4818-8641-7a0f72e74403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:22 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Volume volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 (b03754c5-cc46-4492-a1ba-3c946d3c81a4): created successfully Jul 18 05:38:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1222f9eb-0580-4818-8641-7a0f72e74403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Flow 'volume_create_manager' (bf97c6bb-8525-444b-bb47-079ad8e3b0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:38:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-18dc8bbe-b70a-4252-8c26-fd4f5f35d3d7 tempest-TaggedAttachmentsTest-2071554030 None] Created volume successfully. Jul 18 05:38:32 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:38:32 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Flow 'volume_create_manager' (a416a15c-7630-4e92-9897-630d035b0d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284b3781-61aa-4f74-a330-a445367d3f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284b3781-61aa-4f74-a330-a445367d3f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1281443531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354e7741-a301-4bd5-8ab8-e311a3fea850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b887ec5e804ad483b3854477d5dc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:38:36Z,use_quota=True,user_id='e082798a0eec45b698f8b9d58e501f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca180b22-6992-4b67-b247-8b0113e50c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca180b22-6992-4b67-b247-8b0113e50c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86e3e42-85c0-4d93-963e-8ad766a4efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86e3e42-85c0-4d93-963e-8ad766a4efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354e7741-a301-4bd5-8ab8-e311a3fea850', 'volume_name': 'volume-354e7741-a301-4bd5-8ab8-e311a3fea850', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb1e2c6-85d0-43cd-be7d-68b58967d9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb1e2c6-85d0-43cd-be7d-68b58967d9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5cde17-c34e-40dc-bffe-e2c5d2b9dedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:35 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Volume 354e7741-a301-4bd5-8ab8-e311a3fea850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354e7741-a301-4bd5-8ab8-e311a3fea850', 'volume_size': 1} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1281443531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354e7741-a301-4bd5-8ab8-e311a3fea850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b887ec5e804ad483b3854477d5dc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:38:36Z,use_quota=True,user_id='e082798a0eec45b698f8b9d58e501f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Creating volume 354e7741-a301-4bd5-8ab8-e311a3fea850 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:38:35 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:38:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:35 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850 1073741824 Jul 18 05:38:35 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:36 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850 1073741824" returned: 0 in 0.928s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:36 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850 Jul 18 05:38:36 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:37 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850" returned: 0 in 0.332s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:38:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:38:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5cde17-c34e-40dc-bffe-e2c5d2b9dedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354e7741-a301-4bd5-8ab8-e311a3fea850', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2115151a-fc79-4de6-b6d7-87f31fda9b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:37 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Volume volume-354e7741-a301-4bd5-8ab8-e311a3fea850 (354e7741-a301-4bd5-8ab8-e311a3fea850): created successfully Jul 18 05:38:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2115151a-fc79-4de6-b6d7-87f31fda9b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Flow 'volume_create_manager' (a416a15c-7630-4e92-9897-630d035b0d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:38:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0daffc08-2ce2-4dbe-a7ec-52069ed26b93 tempest-DeleteServersTestJSON-1592869723 None] Created volume successfully. Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Flow 'volume_create_manager' (bb94cdd9-f9a6-438b-8c2b-a23da6207cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820ce1cf-6542-4e99-954a-99386452bc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820ce1cf-6542-4e99-954a-99386452bc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-877458380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bd9b74-98c5-4435-ab34-843c61cf450b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a3e223d6fc409b9fbd0781b3617d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:38:44Z,use_quota=True,user_id='6d39d754046d4b8e87562c2ba1f35796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c132b1-a6ff-4865-965e-f442b61b9d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c132b1-a6ff-4865-965e-f442b61b9d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6371c56-e88c-4c9f-b269-dd30ab6afad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6371c56-e88c-4c9f-b269-dd30ab6afad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1bd9b74-98c5-4435-ab34-843c61cf450b', 'volume_name': 'volume-c1bd9b74-98c5-4435-ab34-843c61cf450b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e658e98-1fad-48f8-8e69-01965af0aa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e658e98-1fad-48f8-8e69-01965af0aa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c1ec08-ff75-43d6-9837-cd3549c20336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:44 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Volume c1bd9b74-98c5-4435-ab34-843c61cf450b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1bd9b74-98c5-4435-ab34-843c61cf450b', 'volume_size': 1} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-877458380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bd9b74-98c5-4435-ab34-843c61cf450b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12a3e223d6fc409b9fbd0781b3617d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:38:44Z,use_quota=True,user_id='6d39d754046d4b8e87562c2ba1f35796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Creating volume c1bd9b74-98c5-4435-ab34-843c61cf450b {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:38:44 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:38:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:44 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b 1073741824 Jul 18 05:38:44 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:45 devstack cinder-volume[87497]: WARNING py.warnings [req-4aad2d37-068f-45d9-81f9-c621a09cf173 req-0529a95c-50c6-443a-8d4b-6212f889b88c tempest-DeleteServersTestJSON-1592869723 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 18 05:38:45 devstack cinder-volume[87497]: .first() Jul 18 05:38:45 devstack cinder-volume[87497]: Jul 18 05:38:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-4aad2d37-068f-45d9-81f9-c621a09cf173 req-0529a95c-50c6-443a-8d4b-6212f889b88c tempest-DeleteServersTestJSON-1592869723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:38:46 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b 1073741824" returned: 0 in 1.449s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:46 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b Jul 18 05:38:46 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:46 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b" returned: 0 in 0.495s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:38:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:38:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-4aad2d37-068f-45d9-81f9-c621a09cf173 req-0529a95c-50c6-443a-8d4b-6212f889b88c tempest-DeleteServersTestJSON-1592869723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.132s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:38:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c1ec08-ff75-43d6-9837-cd3549c20336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1bd9b74-98c5-4435-ab34-843c61cf450b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ed7ab6-208e-44d1-8e82-27535dcca131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:38:47 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Volume volume-c1bd9b74-98c5-4435-ab34-843c61cf450b (c1bd9b74-98c5-4435-ab34-843c61cf450b): created successfully Jul 18 05:38:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ed7ab6-208e-44d1-8e82-27535dcca131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:38:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Flow 'volume_create_manager' (bb94cdd9-f9a6-438b-8c2b-a23da6207cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:38:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-4aad2d37-068f-45d9-81f9-c621a09cf173 req-0529a95c-50c6-443a-8d4b-6212f889b88c tempest-DeleteServersTestJSON-1592869723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.218s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:38:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1a6dc400-f727-4e3e-89e4-af8179c90278 tempest-VolumesAdminNegativeTest-45111522 None] Created volume successfully. Jul 18 05:38:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-4aad2d37-068f-45d9-81f9-c621a09cf173 req-0529a95c-50c6-443a-8d4b-6212f889b88c tempest-DeleteServersTestJSON-1592869723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-354e7741-a301-4bd5-8ab8-e311a3fea850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c077def5-17b1-44d9-add0-05b48c37c636', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:38:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-4aad2d37-068f-45d9-81f9-c621a09cf173 req-0529a95c-50c6-443a-8d4b-6212f889b88c tempest-DeleteServersTestJSON-1592869723 None] attachment_update completed successfully. Jul 18 05:38:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Acquiring lock "cinder-c1bd9b74-98c5-4435-ab34-843c61cf450b-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:38:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Lock "cinder-c1bd9b74-98c5-4435-ab34-843c61cf450b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:38:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Acquiring lock "cinder-quobyte-c1bd9b74-98c5-4435-ab34-843c61cf450b" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:38:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Lock "cinder-quobyte-c1bd9b74-98c5-4435-ab34-843c61cf450b" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:38:48 devstack cinder-volume[87497]: INFO oslo.privsep.daemon [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprrxuxe3i/privsep.sock'] Jul 18 05:38:49 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprrxuxe3i/privsep.sock Jul 18 05:38:49 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:51 devstack cinder-volume[87497]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 18 05:38:51 devstack cinder-volume[87497]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 18 05:38:51 devstack cinder-volume[87497]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 18 05:38:51 devstack cinder-volume[87497]: WARNING oslo.privsep.daemon [-] privsep log: Jul 18 05:38:51 devstack cinder-volume[87497]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 18 05:38:51 devstack cinder-volume[87497]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 18 05:38:51 devstack cinder-volume[87497]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 18 05:38:51 devstack cinder-volume[87497]: WARNING oslo.privsep.daemon [-] privsep log: Jul 18 05:38:51 devstack cinder-volume[87497]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 18 05:38:51 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:51 devstack cinder-volume[87497]: INFO oslo.privsep.daemon [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Spawned new privsep daemon via rootwrap Jul 18 05:38:51 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Accepted privsep connection to /tmp/tmprrxuxe3i/privsep.sock {{(pid=87497) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 18 05:38:51 devstack cinder-volume[87497]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 18 05:38:51 devstack cinder-volume[87497]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 18 05:38:51 devstack cinder-volume[87497]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 18 05:38:51 devstack cinder-volume[87497]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88960 Jul 18 05:38:51 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eeb6a9-7c6e-4c80-9460-3d52c022f27c]: (2,) {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:38:51 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ea157d-d51d-4685-81e9-ff0ad320a691]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:38:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:52 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b Jul 18 05:38:52 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:52 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b" returned: 0 in 1.061s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:52 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b Jul 18 05:38:52 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:53 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c1bd9b74-98c5-4435-ab34-843c61cf450b" returned: 0 in 0.544s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Lock "cinder-quobyte-c1bd9b74-98c5-4435-ab34-843c61cf450b" released by "delete_volume" :: held 4.531s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:38:53 devstack cinder-volume[87497]: WARNING cinder.quota [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:38:53 devstack cinder-volume[87497]: WARNING cinder.quota [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:38:53 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Created reservations ['e2754074-e8ad-4c94-b7fc-345fae53a102', '6c79a5b7-4641-4998-af73-92eda5cc7af7', '35ca9b9d-1c1d-4143-9778-2d4b36174b2b', '4c588c1d-3123-438e-a19e-792ab3561d22'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:38:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:38:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:38:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:38:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:38:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:38:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:53 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:38:53 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:54 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.318s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:54 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:38:54 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Deleted volume successfully. Jul 18 05:38:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-10bb36ee-1057-46c6-9b26-9987bbe96db6 tempest-VolumesAdminNegativeTest-45111522 None] Lock "cinder-c1bd9b74-98c5-4435-ab34-843c61cf450b-delete_volume" released by "delete_volume" :: held 5.441s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:38:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-024f94eb-cb4f-4fb1-9e9f-582616b11962 req-a331b48c-723f-472f-8ba1-92065b43c0eb tempest-DeleteServersTestJSON-1592869723 None] Terminate volume connection completed successfully. Jul 18 05:38:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-024f94eb-cb4f-4fb1-9e9f-582616b11962 req-a331b48c-723f-472f-8ba1-92065b43c0eb tempest-DeleteServersTestJSON-1592869723 None] Deleting attachment c077def5-17b1-44d9-add0-05b48c37c636. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:38:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Acquiring lock "cinder-354e7741-a301-4bd5-8ab8-e311a3fea850-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:38:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Lock "cinder-354e7741-a301-4bd5-8ab8-e311a3fea850-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:38:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Acquiring lock "cinder-quobyte-354e7741-a301-4bd5-8ab8-e311a3fea850" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:38:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Lock "cinder-quobyte-354e7741-a301-4bd5-8ab8-e311a3fea850" acquired by "delete_volume" :: waited 0.053s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:38:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9972ad8-951b-4507-a537-f4dc7809e7a4]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:38:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:57 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850 Jul 18 05:38:57 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:57 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850" returned: 0 in 0.694s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:57 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850 Jul 18 05:38:57 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:58 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-354e7741-a301-4bd5-8ab8-e311a3fea850" returned: 0 in 0.283s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Lock "cinder-quobyte-354e7741-a301-4bd5-8ab8-e311a3fea850" released by "delete_volume" :: held 1.062s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Created reservations ['e6a92fc4-18d6-496e-b741-7fc2528c4ab1', '348f6834-2447-40bd-9409-21eced7be3ee', '64b218c7-f80a-4c94-8228-a73aca6b8dfd', 'b7db84e7-997f-4dd5-b490-bec7a5a07cdc'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:38:58 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:38:58 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:38:58 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.338s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:38:58 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Deleted volume successfully. Jul 18 05:38:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-94d78aa5-7523-4257-9557-c54927ade1d6 tempest-DeleteServersTestJSON-1592869723 None] Lock "cinder-354e7741-a301-4bd5-8ab8-e311a3fea850-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:06 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:39:06 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:06 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.430s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 8 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:39:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:39:08 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=23,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:39:08 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=21,cinder:SELECT=20,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Flow 'volume_create_manager' (965b80e4-09e8-4c74-84eb-10baeb7af392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef525e1-d688-4f11-bef0-6a4039b81eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef525e1-d688-4f11-bef0-6a4039b81eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-135784369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3467a1-52b5-4af1-87f5-e339a7596f68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='801dc72acb7c4be498903a7e130e3c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:11Z,use_quota=True,user_id='88e5ccc72c8e45b286e39067c6659df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a3b83d-d528-4676-b72b-563bbdd4eb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a3b83d-d528-4676-b72b-563bbdd4eb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cc803e-5e13-4360-afa2-0aea68d58b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cc803e-5e13-4360-afa2-0aea68d58b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef3467a1-52b5-4af1-87f5-e339a7596f68', 'volume_name': 'volume-ef3467a1-52b5-4af1-87f5-e339a7596f68', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c3f25b-3cdf-4cf4-865f-e74066b2248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c3f25b-3cdf-4cf4-865f-e74066b2248c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1539931d-cae9-40a4-94de-3d669416ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:10 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Volume ef3467a1-52b5-4af1-87f5-e339a7596f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef3467a1-52b5-4af1-87f5-e339a7596f68', 'volume_size': 1} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-135784369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3467a1-52b5-4af1-87f5-e339a7596f68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='801dc72acb7c4be498903a7e130e3c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:11Z,use_quota=True,user_id='88e5ccc72c8e45b286e39067c6659df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Creating volume ef3467a1-52b5-4af1-87f5-e339a7596f68 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:39:10 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:39:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:10 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 1073741824 Jul 18 05:39:10 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:11 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 1073741824" returned: 0 in 0.477s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:11 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 Jul 18 05:39:11 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:11 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68" returned: 0 in 0.378s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:39:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1539931d-cae9-40a4-94de-3d669416ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3467a1-52b5-4af1-87f5-e339a7596f68', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f774c49d-5d8d-4036-b017-2158c339b966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:11 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Volume volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 (ef3467a1-52b5-4af1-87f5-e339a7596f68): created successfully Jul 18 05:39:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f774c49d-5d8d-4036-b017-2158c339b966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Flow 'volume_create_manager' (965b80e4-09e8-4c74-84eb-10baeb7af392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:11 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-21782da2-4b3c-41b1-a1f1-61102dcdeabc tempest-VolumesTestJSON-298073822 None] Created volume successfully. Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Flow 'volume_create_manager' (d142de77-7717-4b96-905d-4952ec25c502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c16a928-e174-4e0d-8970-a0c331589466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c16a928-e174-4e0d-8970-a0c331589466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1941769862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da760841-fe93-4a9c-a2e1-a826ca63b842,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='801dc72acb7c4be498903a7e130e3c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:14Z,use_quota=True,user_id='88e5ccc72c8e45b286e39067c6659df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51198cf7-b37e-455f-b68b-4461ed878ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51198cf7-b37e-455f-b68b-4461ed878ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92791e9-c231-4c5c-936b-d3ad0d193218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92791e9-c231-4c5c-936b-d3ad0d193218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da760841-fe93-4a9c-a2e1-a826ca63b842', 'volume_name': 'volume-da760841-fe93-4a9c-a2e1-a826ca63b842', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afc5f07-4b49-47b7-bb8d-1b1d16fb9a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afc5f07-4b49-47b7-bb8d-1b1d16fb9a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13974c0c-4ea1-4900-962a-d618dc67702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:13 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Volume da760841-fe93-4a9c-a2e1-a826ca63b842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da760841-fe93-4a9c-a2e1-a826ca63b842', 'volume_size': 1} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1941769862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da760841-fe93-4a9c-a2e1-a826ca63b842,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='801dc72acb7c4be498903a7e130e3c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:14Z,use_quota=True,user_id='88e5ccc72c8e45b286e39067c6659df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Creating volume da760841-fe93-4a9c-a2e1-a826ca63b842 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:39:13 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:39:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:13 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842 1073741824 Jul 18 05:39:13 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:14 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842 1073741824" returned: 0 in 0.547s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:14 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842 Jul 18 05:39:14 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:14 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842" returned: 0 in 0.301s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:39:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13974c0c-4ea1-4900-962a-d618dc67702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da760841-fe93-4a9c-a2e1-a826ca63b842', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d771406c-63ff-4f9a-bc8e-45cb70320ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:14 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Volume volume-da760841-fe93-4a9c-a2e1-a826ca63b842 (da760841-fe93-4a9c-a2e1-a826ca63b842): created successfully Jul 18 05:39:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d771406c-63ff-4f9a-bc8e-45cb70320ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Flow 'volume_create_manager' (d142de77-7717-4b96-905d-4952ec25c502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-127cf1e6-537b-4a87-9f30-25cd84eea952 tempest-VolumesTestJSON-298073822 None] Created volume successfully. Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Flow 'volume_create_manager' (0322f9f0-6ddf-45d5-ad68-20ec57db0f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195ba236-f97c-4c5a-ab69-2cae42fab631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195ba236-f97c-4c5a-ab69-2cae42fab631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1871430418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ec3db9-1e6a-4637-9146-3692781c3fa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='801dc72acb7c4be498903a7e130e3c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:16Z,use_quota=True,user_id='88e5ccc72c8e45b286e39067c6659df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8f6551-7b45-4b3e-ba45-f285968a7481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8f6551-7b45-4b3e-ba45-f285968a7481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc80564e-14f8-4743-94c9-021673cc3d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc80564e-14f8-4743-94c9-021673cc3d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ec3db9-1e6a-4637-9146-3692781c3fa6', 'volume_name': 'volume-76ec3db9-1e6a-4637-9146-3692781c3fa6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b733f311-de83-4e76-83e6-c0a7331deb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b733f311-de83-4e76-83e6-c0a7331deb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929f0823-2e66-4e33-ba29-fc194606073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Volume 76ec3db9-1e6a-4637-9146-3692781c3fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ec3db9-1e6a-4637-9146-3692781c3fa6', 'volume_size': 1} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1871430418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ec3db9-1e6a-4637-9146-3692781c3fa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='801dc72acb7c4be498903a7e130e3c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:16Z,use_quota=True,user_id='88e5ccc72c8e45b286e39067c6659df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Creating volume 76ec3db9-1e6a-4637-9146-3692781c3fa6 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:39:16 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:39:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:16 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 1073741824 Jul 18 05:39:16 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:17 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 1073741824" returned: 0 in 0.491s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:17 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 Jul 18 05:39:17 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:17 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6" returned: 0 in 0.463s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:39:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929f0823-2e66-4e33-ba29-fc194606073c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ec3db9-1e6a-4637-9146-3692781c3fa6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4a2caf-16a2-4c88-a387-f4fdb53b888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Volume volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 (76ec3db9-1e6a-4637-9146-3692781c3fa6): created successfully Jul 18 05:39:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4a2caf-16a2-4c88-a387-f4fdb53b888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Flow 'volume_create_manager' (0322f9f0-6ddf-45d5-ad68-20ec57db0f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:17 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1f687922-1c88-4461-bf71-253dbfaef406 tempest-VolumesTestJSON-298073822 None] Created volume successfully. Jul 18 05:39:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Acquiring lock "cinder-76ec3db9-1e6a-4637-9146-3692781c3fa6-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Lock "cinder-76ec3db9-1e6a-4637-9146-3692781c3fa6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Acquiring lock "cinder-quobyte-76ec3db9-1e6a-4637-9146-3692781c3fa6" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Lock "cinder-quobyte-76ec3db9-1e6a-4637-9146-3692781c3fa6" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31b891-5616-4f21-8bd0-d299f863fc39]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:39:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:20 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 Jul 18 05:39:20 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:21 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6" returned: 0 in 0.462s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:21 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6 Jul 18 05:39:21 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:21 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-76ec3db9-1e6a-4637-9146-3692781c3fa6" returned: 0 in 0.343s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Lock "cinder-quobyte-76ec3db9-1e6a-4637-9146-3692781c3fa6" released by "delete_volume" :: held 0.854s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Created reservations ['03697964-2aff-4588-8af3-96969ed261af', '7e8064fb-c9bb-4144-a51f-faf8ff10ffca', '88e18176-ec08-4fc2-8b94-ede5d8e3a13a', '18206d56-d243-4959-822b-74e9414814e5'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:21 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:39:21 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Acquiring lock "cinder-da760841-fe93-4a9c-a2e1-a826ca63b842-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Lock "cinder-da760841-fe93-4a9c-a2e1-a826ca63b842-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Acquiring lock "cinder-quobyte-da760841-fe93-4a9c-a2e1-a826ca63b842" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Lock "cinder-quobyte-da760841-fe93-4a9c-a2e1-a826ca63b842" acquired by "delete_volume" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:22 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[573d865b-27fb-4e7c-8108-f612a25d425d]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:39:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:22 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.429s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:22 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:39:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Deleted volume successfully. Jul 18 05:39:22 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842 Jul 18 05:39:22 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6d58ad95-aa5c-4ec7-82b1-abff3487a9f6 tempest-VolumesTestJSON-298073822 None] Lock "cinder-76ec3db9-1e6a-4637-9146-3692781c3fa6-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:22 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842" returned: 0 in 0.500s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:22 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842 Jul 18 05:39:22 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:22 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-da760841-fe93-4a9c-a2e1-a826ca63b842" returned: 0 in 0.448s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Lock "cinder-quobyte-da760841-fe93-4a9c-a2e1-a826ca63b842" released by "delete_volume" :: held 1.048s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Created reservations ['d9258cb3-c821-4e85-b175-1440205401bb', 'd4af5f5b-770a-48a1-8e9c-53ebfdec0804', 'c59e2465-a7d4-4ec1-ab11-3757a8f143a8', '42cfb9eb-bf73-455b-97d9-f786d4402c2a'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:23 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:39:23 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:23 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.538s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:39:23 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Deleted volume successfully. Jul 18 05:39:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-99f04cb4-5ce0-4b5e-9742-26645fed2878 tempest-VolumesTestJSON-298073822 None] Lock "cinder-da760841-fe93-4a9c-a2e1-a826ca63b842-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Acquiring lock "cinder-ef3467a1-52b5-4af1-87f5-e339a7596f68-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Lock "cinder-ef3467a1-52b5-4af1-87f5-e339a7596f68-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Acquiring lock "cinder-quobyte-ef3467a1-52b5-4af1-87f5-e339a7596f68" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Lock "cinder-quobyte-ef3467a1-52b5-4af1-87f5-e339a7596f68" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:24 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df236b8-3df2-4bdf-8ef0-b360a2ebe2a0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:39:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:25 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 Jul 18 05:39:25 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:25 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68" returned: 0 in 0.787s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:25 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68 Jul 18 05:39:25 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:25 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef3467a1-52b5-4af1-87f5-e339a7596f68" returned: 0 in 0.355s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Lock "cinder-quobyte-ef3467a1-52b5-4af1-87f5-e339a7596f68" released by "delete_volume" :: held 1.254s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-95de80a9-f43d-44f4-8672-11a4a552191e req-96fe7bd1-571f-4d03-80b0-e5e1eb120aeb tempest-TaggedAttachmentsTest-2071554030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-95de80a9-f43d-44f4-8672-11a4a552191e req-96fe7bd1-571f-4d03-80b0-e5e1eb120aeb tempest-TaggedAttachmentsTest-2071554030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-95de80a9-f43d-44f4-8672-11a4a552191e req-96fe7bd1-571f-4d03-80b0-e5e1eb120aeb tempest-TaggedAttachmentsTest-2071554030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Created reservations ['22350f83-6b55-4612-9414-1948e32a1da4', '1f17ffbf-b599-4e21-b6ea-73ad654a1c29', '177a58ec-2aa4-4ab5-818d-32438b283174', '008dcc55-185c-4ed4-9d39-459fd96d028b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-95de80a9-f43d-44f4-8672-11a4a552191e req-96fe7bd1-571f-4d03-80b0-e5e1eb120aeb tempest-TaggedAttachmentsTest-2071554030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ff87817-f4e8-4cf3-a3c5-1c03cc0a2365', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-95de80a9-f43d-44f4-8672-11a4a552191e req-96fe7bd1-571f-4d03-80b0-e5e1eb120aeb tempest-TaggedAttachmentsTest-2071554030 None] attachment_update completed successfully. Jul 18 05:39:26 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:39:26 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:26 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.553s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:39:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Deleted volume successfully. Jul 18 05:39:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-88bd5663-d27f-4346-a8f0-2c88620d6e98 tempest-VolumesTestJSON-298073822 None] Lock "cinder-ef3467a1-52b5-4af1-87f5-e339a7596f68-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-b7870040-f33b-44b7-bd64-7c260c99a29c req-6922c993-eb96-4033-9dc4-ccb47b044c81 tempest-TaggedAttachmentsTest-2071554030 None] Terminate volume connection completed successfully. Jul 18 05:39:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-b7870040-f33b-44b7-bd64-7c260c99a29c req-6922c993-eb96-4033-9dc4-ccb47b044c81 tempest-TaggedAttachmentsTest-2071554030 None] Deleting attachment 9ff87817-f4e8-4cf3-a3c5-1c03cc0a2365. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:39:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e0f2e170-debb-489d-a5f9-8c6d307682ba tempest-GroupSnapshotsV319Test-740558736 None] Group tempest-GroupSnapshotsV319Test-Group-1192040088: creating Jul 18 05:39:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e0f2e170-debb-489d-a5f9-8c6d307682ba tempest-GroupSnapshotsV319Test-740558736 None] Group tempest-GroupSnapshotsV319Test-Group-1192040088: created successfully Jul 18 05:39:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e0f2e170-debb-489d-a5f9-8c6d307682ba tempest-GroupSnapshotsV319Test-740558736 None] Create group completed successfully. Jul 18 05:39:37 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:39:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Flow 'volume_create_manager' (dd164a7c-bab0-4706-8535-e35d3fe22504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2018c4d8-f53b-43e0-b3f1-b5dbf5c9a546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2018c4d8-f53b-43e0-b3f1-b5dbf5c9a546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-738798044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60c2acb6-9817-46a2-8ddc-6e951dd936e8,host='devstack@QuobyteHD#QuobyteHD',id=ce4d2e37-42ff-456d-b54a-ebb9e4941e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daa944c36b54f6dbbedba55b0fc1f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:38Z,use_quota=True,user_id='f14ca1983cd64053ad093582015a4666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efb322e4-6c5a-4cd4-894a-56a0756ff62a),volume_type_id=efb322e4-6c5a-4cd4-894a-56a0756ff62a)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e616bd1-e9f7-4685-ae31-f7689f048808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e616bd1-e9f7-4685-ae31-f7689f048808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c99cb12-9cb7-46d4-adfa-dec20a4eb0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c99cb12-9cb7-46d4-adfa-dec20a4eb0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4d2e37-42ff-456d-b54a-ebb9e4941e09', 'volume_name': 'volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f2c803-7ec3-4d43-8c2e-4404eb85108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f2c803-7ec3-4d43-8c2e-4404eb85108b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892462e9-3bc1-4b44-857a-c1caba9ddd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:38 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Volume ce4d2e37-42ff-456d-b54a-ebb9e4941e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09', 'volume_size': 1} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60c2acb6-9817-46a2-8ddc-6e951dd936e8,created_at=2026-07-18T03:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-738798044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60c2acb6-9817-46a2-8ddc-6e951dd936e8,host='devstack@QuobyteHD#QuobyteHD',id=ce4d2e37-42ff-456d-b54a-ebb9e4941e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daa944c36b54f6dbbedba55b0fc1f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:38Z,use_quota=True,user_id='f14ca1983cd64053ad093582015a4666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efb322e4-6c5a-4cd4-894a-56a0756ff62a),volume_type_id=efb322e4-6c5a-4cd4-894a-56a0756ff62a)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Creating volume ce4d2e37-42ff-456d-b54a-ebb9e4941e09 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:39:38 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:38 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 1073741824 Jul 18 05:39:38 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:38 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 1073741824" returned: 0 in 0.885s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:39 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 Jul 18 05:39:39 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:39 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" returned: 0 in 0.477s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:39:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892462e9-3bc1-4b44-857a-c1caba9ddd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4756cf-095f-41b4-b688-29bc76b99df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:39 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Volume volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 (ce4d2e37-42ff-456d-b54a-ebb9e4941e09): created successfully Jul 18 05:39:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4756cf-095f-41b4-b688-29bc76b99df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Flow 'volume_create_manager' (dd164a7c-bab0-4706-8535-e35d3fe22504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-48e9cf8d-14f9-42f4-b87c-1fcd479ace87 tempest-GroupSnapshotsV319Test-740558736 None] Created volume successfully. Jul 18 05:39:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] GroupSnapshot 96149524-23f8-4bcb-af61-06d7f4e49770: creating. Jul 18 05:39:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Group snapshot 96149524-23f8-4bcb-af61-06d7f4e49770: creating. {{(pid=87497) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 18 05:39:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Creating offline snapshot 006b59a4-d98f-4224-b879-9aaeda0557af of volume ce4d2e37-42ff-456d-b54a-ebb9e4941e09 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:39:41 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb3db29-1726-4d54-b6c1-209287e7e2be]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:39:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:41 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 Jul 18 05:39:41 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:41 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" returned: 0 in 0.481s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:41 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af 1G Jul 18 05:39:41 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:42 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af 1G" returned: 0 in 0.560s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:42 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af Jul 18 05:39:42 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:42 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af" returned: 0 in 0.410s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:42 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:39:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:42 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af Jul 18 05:39:42 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:42 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af" returned: 0 in 0.313s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:42 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.info Jul 18 05:39:42 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:43 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.info" returned: 0 in 0.308s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:43 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:39:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:43 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.info Jul 18 05:39:43 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:43 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.info" returned: 0 in 0.341s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-860ca46d-469a-4e5e-9965-4b7708df6b5b tempest-GroupSnapshotsV319Test-740558736 None] group_snapshot 96149524-23f8-4bcb-af61-06d7f4e49770: created successfully Jul 18 05:39:44 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] group_snapshot 96149524-23f8-4bcb-af61-06d7f4e49770: deleting Jul 18 05:39:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] group_snapshot 96149524-23f8-4bcb-af61-06d7f4e49770: deleting {{(pid=87497) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 18 05:39:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Acquiring lock "cinder-quobyte-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Lock "cinder-quobyte-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Acquiring lock "cinder-quobyte-006b59a4-d98f-4224-b879-9aaeda0557af" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Lock "cinder-quobyte-006b59a4-d98f-4224-b879-9aaeda0557af" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Deleting offline snapshot 006b59a4-d98f-4224-b879-9aaeda0557af of volume ce4d2e37-42ff-456d-b54a-ebb9e4941e09 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:39:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] snapshot_file for this snap is: volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:39:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920b491-3788-4014-8b18-b71563eda1c6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:39:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:45 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af Jul 18 05:39:45 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:45 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af" returned: 0 in 0.587s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:39:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a2262a-cf1b-47dd-9d74-a97bb618d99b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:39:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:45 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 Jul 18 05:39:45 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:46 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" returned: 0 in 0.660s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:46 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af Jul 18 05:39:46 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:46 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af" returned: 0 in 0.577s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:46 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af Jul 18 05:39:46 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:47 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09.006b59a4-d98f-4224-b879-9aaeda0557af" returned: 0 in 0.655s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Lock "cinder-quobyte-006b59a4-d98f-4224-b879-9aaeda0557af" released by "_delete_snapshot" :: held 2.642s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Lock "cinder-quobyte-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" released by "delete_snapshot" :: held 2.685s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:47 devstack cinder-volume[87497]: WARNING cinder.quota [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-459308721 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-459308721, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:39:47 devstack cinder-volume[87497]: WARNING cinder.quota [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-459308721 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-459308721, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] Created reservations ['e0f386f1-ba54-44fc-96c2-e5c4e8605d04', 'b7780002-c124-41a5-9f21-c2a507bc7b6a', 'a92af872-bbb4-49b0-a3b6-8c5e9532dd29', '591568b6-0f20-4a4f-ade5-faa98b05e349'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Acquiring lock "cinder-b03754c5-cc46-4492-a1ba-3c946d3c81a4-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "cinder-b03754c5-cc46-4492-a1ba-3c946d3c81a4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-02e20375-2b08-4686-9e20-4b6013adea9b tempest-GroupSnapshotsV319Test-740558736 None] group_snapshot 96149524-23f8-4bcb-af61-06d7f4e49770: deleted successfully Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Acquiring lock "cinder-quobyte-b03754c5-cc46-4492-a1ba-3c946d3c81a4" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "cinder-quobyte-b03754c5-cc46-4492-a1ba-3c946d3c81a4" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5f8c65-95a6-4340-bc4d-3b706ce34d86]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:39:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:48 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 Jul 18 05:39:48 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:48 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4" returned: 0 in 0.553s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:48 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4 Jul 18 05:39:48 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Acquiring lock "cinder-quobyte-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:39:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Lock "cinder-quobyte-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:39:48 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b03754c5-cc46-4492-a1ba-3c946d3c81a4" returned: 0 in 0.429s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:48 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[62305f54-1328-45ce-8295-e8e71cf8680f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:39:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "cinder-quobyte-b03754c5-cc46-4492-a1ba-3c946d3c81a4" released by "delete_volume" :: held 1.060s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Created reservations ['bfa912c9-7fa8-43e9-9f09-752e04e1b8a3', 'b17aae1a-009f-4a4b-be59-4190a8a7340f', '5a018c90-8a69-42dd-9268-12a8b7ff280b', 'ca0cce3f-aa5d-43e8-b286-8c4c07232fc9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:39:49 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 Jul 18 05:39:49 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:49 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:39:49 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:49 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" returned: 0 in 0.665s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:49 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.442s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:39:49 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09 Jul 18 05:39:49 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:49 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Deleted volume successfully. Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-763f1551-0c19-4bee-88c7-c6fb5b49a5c7 tempest-TaggedAttachmentsTest-2071554030 None] Lock "cinder-b03754c5-cc46-4492-a1ba-3c946d3c81a4-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:49 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" returned: 0 in 0.356s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Lock "cinder-quobyte-ce4d2e37-42ff-456d-b54a-ebb9e4941e09" released by "delete_volume" :: held 1.149s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Created reservations ['3e56d2d6-9f6c-458f-81f9-afaa01ba7323'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:39:50 devstack cinder-volume[87497]: WARNING cinder.quota [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-459308721 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-459308721, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Created reservations ['cce7203d-b769-4b3f-9917-a818491060a5', '37a01e92-5b2e-4d91-ba93-ce6c9003d175', 'd176cfb8-6e8e-4eff-9d48-88a3d3249d85', 'c554561a-486c-4689-b21d-17246606e561'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:50 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:39:50 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:50 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.415s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:50 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:39:50 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-dd370b65-1069-4dc8-94b3-f10cd96e084f tempest-GroupSnapshotsV319Test-740558736 None] Delete group completed successfully. Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Flow 'volume_create_manager' (76264cd6-a8e3-4cf2-bbc5-9389df897b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf7d75e-2b68-4591-a575-a7943a6dae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf7d75e-2b68-4591-a575-a7943a6dae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-568876272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b580def-9910-4572-a368-7078a2fe81c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32766bb076ab402d855a6623b7a84daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:52Z,use_quota=True,user_id='39797c0f82cd41aab642114e4da3a5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aaeaa7c-e901-4ffa-9965-27a0c2253f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aaeaa7c-e901-4ffa-9965-27a0c2253f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dfa6ce-762d-4a75-8f39-27cc1214a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dfa6ce-762d-4a75-8f39-27cc1214a01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b580def-9910-4572-a368-7078a2fe81c8', 'volume_name': 'volume-9b580def-9910-4572-a368-7078a2fe81c8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9c6525-31a6-451d-9f9f-e71b09eb2a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9c6525-31a6-451d-9f9f-e71b09eb2a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f87ae5f-46bc-4ca3-9bf2-e4441626cefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:51 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Volume 9b580def-9910-4572-a368-7078a2fe81c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b580def-9910-4572-a368-7078a2fe81c8', 'volume_size': 1} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-568876272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b580def-9910-4572-a368-7078a2fe81c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32766bb076ab402d855a6623b7a84daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:39:52Z,use_quota=True,user_id='39797c0f82cd41aab642114e4da3a5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Creating volume 9b580def-9910-4572-a368-7078a2fe81c8 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:39:51 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:39:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:52 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8 1073741824 Jul 18 05:39:52 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:52 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8 1073741824" returned: 0 in 0.934s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:39:53 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8 Jul 18 05:39:53 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:39:53 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Jul 18 05:39:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8" returned: 0 in 0.384s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:39:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:39:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:39:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f87ae5f-46bc-4ca3-9bf2-e4441626cefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b580def-9910-4572-a368-7078a2fe81c8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f62f1d8-c1cb-43d4-a1f0-16e00cf418f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:39:53 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Volume volume-9b580def-9910-4572-a368-7078a2fe81c8 (9b580def-9910-4572-a368-7078a2fe81c8): created successfully Jul 18 05:39:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f62f1d8-c1cb-43d4-a1f0-16e00cf418f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:39:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Flow 'volume_create_manager' (76264cd6-a8e3-4cf2-bbc5-9389df897b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:39:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e5ba041b-af4d-46e5-856b-093a93b3854a tempest-ServerActionsTestOtherA-2051112331 None] Created volume successfully. Jul 18 05:40:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9abb177d-d549-43b8-8a93-b2c386047b85 tempest-GroupsV320Test-774276739 None] Group tempest-GroupsV320Test-Group-613270505: creating Jul 18 05:40:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9abb177d-d549-43b8-8a93-b2c386047b85 tempest-GroupsV320Test-774276739 None] Group tempest-GroupsV320Test-Group-613270505: created successfully Jul 18 05:40:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9abb177d-d549-43b8-8a93-b2c386047b85 tempest-GroupsV320Test-774276739 None] Create group completed successfully. Jul 18 05:40:04 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] Created reservations ['875c8809-b190-4f0b-9b77-4f0d9cf92121'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:40:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:05 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:40:05 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:05 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.483s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:05 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:40:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-695f11c9-1c58-448e-affc-c9c0cd70ea8c tempest-GroupsV320Test-774276739 None] Delete group completed successfully. Jul 18 05:40:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:40:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:06 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:40:06 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:06 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.351s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=70,cinder:UPDATE=74,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=72,cinder:SELECT=65,cinder:DELETE=5,cinder:INSERT=12 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Flow 'volume_create_manager' (965c708b-cc3c-4210-87ef-44cc9a7262b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee59eb-a6d7-4bf0-b7a2-ffa1ed334595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee59eb-a6d7-4bf0-b7a2-ffa1ed334595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-327025495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef3f0f6-b6df-4118-ae82-40c033c2ca0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a3036259794e43a2b055840505dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:10Z,use_quota=True,user_id='3e7982f014cd4354bc9e2415fc2aec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95573034-744d-40c7-a238-c46d7379928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95573034-744d-40c7-a238-c46d7379928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68af1d01-12a7-4c57-bb61-5bc32affb26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68af1d01-12a7-4c57-bb61-5bc32affb26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef3f0f6-b6df-4118-ae82-40c033c2ca0a', 'volume_name': 'volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4215d1-760b-40b2-8758-247a953d3fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4215d1-760b-40b2-8758-247a953d3fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecb5d38-f6f8-4d28-8a04-38e8d6f9bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:10 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Volume 4ef3f0f6-b6df-4118-ae82-40c033c2ca0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a', 'volume_size': 1} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-327025495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef3f0f6-b6df-4118-ae82-40c033c2ca0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a3036259794e43a2b055840505dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:10Z,use_quota=True,user_id='3e7982f014cd4354bc9e2415fc2aec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Creating volume 4ef3f0f6-b6df-4118-ae82-40c033c2ca0a {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:40:10 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:40:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:10 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a 1073741824 Jul 18 05:40:10 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:11 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a 1073741824" returned: 0 in 0.776s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:11 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a Jul 18 05:40:11 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:11 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a" returned: 0 in 0.326s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:40:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecb5d38-f6f8-4d28-8a04-38e8d6f9bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aaddeb-fc0b-47fe-8b68-36599a2764c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:11 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Volume volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a (4ef3f0f6-b6df-4118-ae82-40c033c2ca0a): created successfully Jul 18 05:40:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aaddeb-fc0b-47fe-8b68-36599a2764c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Flow 'volume_create_manager' (965c708b-cc3c-4210-87ef-44cc9a7262b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:11 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-18958618-b978-49a4-8fbd-cd2f688aeb2e tempest-ServersNegativeTestJSON-937480183 None] Created volume successfully. Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Flow 'volume_create_manager' (a95c1ebe-306a-4096-9b23-490caeb55d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581a9557-2cca-4da9-8d5a-285d9e48e2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581a9557-2cca-4da9-8d5a-285d9e48e2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1772929400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc748daf-d70f-4f95-b748-e53c8ae9e9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a3036259794e43a2b055840505dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:16Z,use_quota=True,user_id='3e7982f014cd4354bc9e2415fc2aec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f9b441-6549-49e1-93af-fca4e4958914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f9b441-6549-49e1-93af-fca4e4958914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083740a7-6558-4b00-a2d2-b6879fa2d47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083740a7-6558-4b00-a2d2-b6879fa2d47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc748daf-d70f-4f95-b748-e53c8ae9e9d8', 'volume_name': 'volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb16fe96-e2ac-4ddc-904f-9fdaab7509ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb16fe96-e2ac-4ddc-904f-9fdaab7509ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90515e8-72fa-4364-889a-1f4ea26530a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Volume bc748daf-d70f-4f95-b748-e53c8ae9e9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8', 'volume_size': 1} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1772929400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc748daf-d70f-4f95-b748-e53c8ae9e9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a3036259794e43a2b055840505dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:16Z,use_quota=True,user_id='3e7982f014cd4354bc9e2415fc2aec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Creating volume bc748daf-d70f-4f95-b748-e53c8ae9e9d8 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:40:15 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:40:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:15 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 1073741824 Jul 18 05:40:15 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:16 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 1073741824" returned: 0 in 0.619s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:16 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 Jul 18 05:40:16 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:16 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:40:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90515e8-72fa-4364-889a-1f4ea26530a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cc3145-42e4-44a4-be49-abee3e6865ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Volume volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 (bc748daf-d70f-4f95-b748-e53c8ae9e9d8): created successfully Jul 18 05:40:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cc3145-42e4-44a4-be49-abee3e6865ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Flow 'volume_create_manager' (a95c1ebe-306a-4096-9b23-490caeb55d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:16 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-99de7a2c-07d9-4805-a77e-2aac9c51daf9 tempest-ServersNegativeTestJSON-937480183 None] Created volume successfully. Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Flow 'volume_create_manager' (51015a59-a4b8-4cfe-a62b-4b408933d93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1591cd-46c0-4319-8fca-aaa95d450b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1591cd-46c0-4319-8fca-aaa95d450b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1680170215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76a35d6-beaf-4788-9c79-8172e3021304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6a4222e70b43779170f6b0588a3a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:18Z,use_quota=True,user_id='c1e7eeef63784324af6d09a0148674d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1cd8ac-666e-4693-b65b-a0134d0006a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1cd8ac-666e-4693-b65b-a0134d0006a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490dbf61-4e08-4db1-b19a-b43560fddffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490dbf61-4e08-4db1-b19a-b43560fddffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76a35d6-beaf-4788-9c79-8172e3021304', 'volume_name': 'volume-b76a35d6-beaf-4788-9c79-8172e3021304', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb32bc1-e131-48be-8446-9dda9d734e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb32bc1-e131-48be-8446-9dda9d734e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86984e41-ad7f-4109-867e-aebad96d54ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Volume b76a35d6-beaf-4788-9c79-8172e3021304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76a35d6-beaf-4788-9c79-8172e3021304', 'volume_size': 1} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1680170215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76a35d6-beaf-4788-9c79-8172e3021304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6a4222e70b43779170f6b0588a3a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:18Z,use_quota=True,user_id='c1e7eeef63784324af6d09a0148674d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Creating volume b76a35d6-beaf-4788-9c79-8172e3021304 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:40:17 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:40:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:18 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304 1073741824 Jul 18 05:40:18 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "cinder-bc748daf-d70f-4f95-b748-e53c8ae9e9d8-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Lock "cinder-bc748daf-d70f-4f95-b748-e53c8ae9e9d8-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "cinder-quobyte-bc748daf-d70f-4f95-b748-e53c8ae9e9d8" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Lock "cinder-quobyte-bc748daf-d70f-4f95-b748-e53c8ae9e9d8" acquired by "delete_volume" :: waited 0.072s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:18 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baa9154-f8b1-47d5-8b41-e58fe7007c95]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:40:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:19 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304 1073741824" returned: 0 in 1.030s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:19 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304 Jul 18 05:40:19 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:19 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 Jul 18 05:40:19 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:19 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304" returned: 0 in 0.467s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86984e41-ad7f-4109-867e-aebad96d54ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76a35d6-beaf-4788-9c79-8172e3021304', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:19 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ad6ad3-6a74-41df-a481-457defbae1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8" returned: 0 in 0.728s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:19 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Volume volume-b76a35d6-beaf-4788-9c79-8172e3021304 (b76a35d6-beaf-4788-9c79-8172e3021304): created successfully Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ad6ad3-6a74-41df-a481-457defbae1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:19 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8 Jul 18 05:40:19 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Flow 'volume_create_manager' (51015a59-a4b8-4cfe-a62b-4b408933d93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f901fb25-ff96-46f8-bf8e-a544f08b9467 tempest-VolumeQuotasAdminTestJSON-23175226 None] Created volume successfully. Jul 18 05:40:20 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bc748daf-d70f-4f95-b748-e53c8ae9e9d8" returned: 0 in 0.447s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Lock "cinder-quobyte-bc748daf-d70f-4f95-b748-e53c8ae9e9d8" released by "delete_volume" :: held 1.250s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Acquiring lock "cinder-b76a35d6-beaf-4788-9c79-8172e3021304-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Created reservations ['618dce68-77ed-4735-a10f-bcfdf8fed7f8', 'ef2951b3-1a67-4f67-9a64-459f223580df', '0144b99f-bfbe-4305-9c27-0e4a20218a29', 'f5b5b970-6bf0-4430-9bd2-692443c5fe2a'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "cinder-b76a35d6-beaf-4788-9c79-8172e3021304-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Acquiring lock "cinder-quobyte-b76a35d6-beaf-4788-9c79-8172e3021304" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "cinder-quobyte-b76a35d6-beaf-4788-9c79-8172e3021304" acquired by "delete_volume" :: waited 0.046s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[04910f2e-633c-4710-8cea-516156f2cd22]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:20 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:40:20 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:20 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304 Jul 18 05:40:20 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:20 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "cinder-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304" returned: 0 in 0.537s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Lock "cinder-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:21 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304 Jul 18 05:40:21 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:21 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "cinder-quobyte-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.618s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:40:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Deleted volume successfully. Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Lock "cinder-quobyte-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a" acquired by "delete_volume" :: waited 0.035s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d32902a2-84b9-4e4f-b864-4b165f7675e1 tempest-ServersNegativeTestJSON-937480183 None] Lock "cinder-bc748daf-d70f-4f95-b748-e53c8ae9e9d8-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1e91aa-c65a-449c-bf03-44d132d28345]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:21 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b76a35d6-beaf-4788-9c79-8172e3021304" returned: 0 in 0.360s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "cinder-quobyte-b76a35d6-beaf-4788-9c79-8172e3021304" released by "delete_volume" :: held 0.980s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:40:21 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a Jul 18 05:40:21 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Created reservations ['926bf08f-96bb-43dc-9fa6-089904720bc7', 'de2eadad-60c7-4273-b68d-e07dee632308', 'c336b55d-48b2-454c-acc7-7766440c82a7', 'd33a85aa-620e-499d-8ea2-32066d7acfb1'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:21 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:40:21 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:21 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a" returned: 0 in 0.505s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:21 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a Jul 18 05:40:21 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:21 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.378s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:21 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:40:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Deleted volume successfully. Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-155d8752-de0f-4af5-8409-419f03967207 tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "cinder-b76a35d6-beaf-4788-9c79-8172e3021304-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:40:22 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a" returned: 0 in 0.319s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Lock "cinder-quobyte-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a" released by "delete_volume" :: held 0.881s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Created reservations ['414a2771-560c-4cf6-8adf-e046dcaeeb8f', 'f103d226-a7cf-4da4-8cf4-c59698dbeaaa', 'd5459271-6790-4338-8703-ff7d58bd23d0', 'a4c6f5fd-c68a-403f-8778-e29c47147b5b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:22 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:40:22 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:22 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.343s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:40:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Deleted volume successfully. Jul 18 05:40:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b84ca08-5fcc-4e58-bdf8-3eb93563adf6 tempest-ServersNegativeTestJSON-937480183 None] Lock "cinder-4ef3f0f6-b6df-4118-ae82-40c033c2ca0a-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Flow 'volume_create_manager' (a4290aa3-a947-4cd0-b9dc-c0667a586037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f9b985-2045-48fc-8aa5-17177c3d3302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f9b985-2045-48fc-8aa5-17177c3d3302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-420191299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3987747-f921-4aab-8dd9-8b2404a1488d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6a4222e70b43779170f6b0588a3a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:23Z,use_quota=True,user_id='c1e7eeef63784324af6d09a0148674d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7199cbc-ad7c-4dd9-a4be-dd42069533ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7199cbc-ad7c-4dd9-a4be-dd42069533ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae9f762-4f26-463b-b90b-5e054d6a1c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae9f762-4f26-463b-b90b-5e054d6a1c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3987747-f921-4aab-8dd9-8b2404a1488d', 'volume_name': 'volume-e3987747-f921-4aab-8dd9-8b2404a1488d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b4677f-eb02-4407-8d50-be97445c4694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b4677f-eb02-4407-8d50-be97445c4694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf355df-ca28-4f6e-a848-1c734138f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:23 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Volume e3987747-f921-4aab-8dd9-8b2404a1488d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3987747-f921-4aab-8dd9-8b2404a1488d', 'volume_size': 1} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-420191299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3987747-f921-4aab-8dd9-8b2404a1488d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6a4222e70b43779170f6b0588a3a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:23Z,use_quota=True,user_id='c1e7eeef63784324af6d09a0148674d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Creating volume e3987747-f921-4aab-8dd9-8b2404a1488d {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:40:23 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:40:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:23 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d 1073741824 Jul 18 05:40:23 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:24 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d 1073741824" returned: 0 in 0.560s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:24 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d Jul 18 05:40:24 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:24 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d" returned: 0 in 0.281s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:40:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf355df-ca28-4f6e-a848-1c734138f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3987747-f921-4aab-8dd9-8b2404a1488d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a5c2e-f573-4a4f-a7b9-939a0cd5204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:24 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Volume volume-e3987747-f921-4aab-8dd9-8b2404a1488d (e3987747-f921-4aab-8dd9-8b2404a1488d): created successfully Jul 18 05:40:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a5c2e-f573-4a4f-a7b9-939a0cd5204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Flow 'volume_create_manager' (a4290aa3-a947-4cd0-b9dc-c0667a586037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:24 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-aab2d496-2a38-4de2-bcc5-9d290e9398be tempest-VolumeQuotasAdminTestJSON-23175226 None] Created volume successfully. Jul 18 05:40:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d84a76bf-1cc8-426d-902c-6ef4b74e0814 tempest-VolumeQuotasAdminTestJSON-1975746340 None] Transfer volume completed successfully. Jul 18 05:40:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Acquiring lock "cinder-e3987747-f921-4aab-8dd9-8b2404a1488d-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Lock "cinder-e3987747-f921-4aab-8dd9-8b2404a1488d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Acquiring lock "cinder-quobyte-e3987747-f921-4aab-8dd9-8b2404a1488d" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Lock "cinder-quobyte-e3987747-f921-4aab-8dd9-8b2404a1488d" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:26 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e8055-5a69-4af5-a113-c04badb16d5a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:40:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:27 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d Jul 18 05:40:27 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:27 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d" returned: 0 in 0.407s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:27 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d Jul 18 05:40:27 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:27 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e3987747-f921-4aab-8dd9-8b2404a1488d" returned: 0 in 0.267s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Lock "cinder-quobyte-e3987747-f921-4aab-8dd9-8b2404a1488d" released by "delete_volume" :: held 0.717s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Created reservations ['61248e5b-959d-4286-9da3-4482285026de', '7bcc0e20-3fd0-41cd-8577-74f01a328c6e', '933137bd-0393-4ac9-997d-4075770ddc48', '72ab5c16-9027-4fa1-9488-c12bb422d5f0'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:27 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:40:27 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:28 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.274s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:28 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:40:28 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Deleted volume successfully. Jul 18 05:40:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c987175b-318d-44f3-8e20-4e23187cefd9 tempest-VolumeQuotasAdminTestJSON-1676234552 None] Lock "cinder-e3987747-f921-4aab-8dd9-8b2404a1488d-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:40:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-9d8d4540-7380-46cb-a120-72e6fe6ac31a req-3697a4f0-2203-431c-af95-a8f5ebf73dfd tempest-ServerActionsTestOtherA-2051112331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-9d8d4540-7380-46cb-a120-72e6fe6ac31a req-3697a4f0-2203-431c-af95-a8f5ebf73dfd tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-9d8d4540-7380-46cb-a120-72e6fe6ac31a req-3697a4f0-2203-431c-af95-a8f5ebf73dfd tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-9d8d4540-7380-46cb-a120-72e6fe6ac31a req-3697a4f0-2203-431c-af95-a8f5ebf73dfd tempest-ServerActionsTestOtherA-2051112331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-9b580def-9910-4572-a368-7078a2fe81c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32738a02-b0b9-4505-8897-09a6ad9f9dd3', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:40:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-9d8d4540-7380-46cb-a120-72e6fe6ac31a req-3697a4f0-2203-431c-af95-a8f5ebf73dfd tempest-ServerActionsTestOtherA-2051112331 None] attachment_update completed successfully. Jul 18 05:40:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-fd4dd4f4-f811-466b-8bb2-cdc94cd7c768 req-c923010d-6f92-4e5b-821a-533ddb32aaaa tempest-ServerActionsTestOtherA-2051112331 None] Terminate volume connection completed successfully. Jul 18 05:40:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-fd4dd4f4-f811-466b-8bb2-cdc94cd7c768 req-c923010d-6f92-4e5b-821a-533ddb32aaaa tempest-ServerActionsTestOtherA-2051112331 None] Deleting attachment 32738a02-b0b9-4505-8897-09a6ad9f9dd3. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:40:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-fd4dd4f4-f811-466b-8bb2-cdc94cd7c768 req-54e0b836-5cfd-42dc-a440-231a2167a5b8 tempest-ServerActionsTestOtherA-2051112331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-fd4dd4f4-f811-466b-8bb2-cdc94cd7c768 req-54e0b836-5cfd-42dc-a440-231a2167a5b8 tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-fd4dd4f4-f811-466b-8bb2-cdc94cd7c768 req-54e0b836-5cfd-42dc-a440-231a2167a5b8 tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-fd4dd4f4-f811-466b-8bb2-cdc94cd7c768 req-54e0b836-5cfd-42dc-a440-231a2167a5b8 tempest-ServerActionsTestOtherA-2051112331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-9b580def-9910-4572-a368-7078a2fe81c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e997ccc-0aa7-4ca9-875f-4f16f367dc68', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:40:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-fd4dd4f4-f811-466b-8bb2-cdc94cd7c768 req-54e0b836-5cfd-42dc-a440-231a2167a5b8 tempest-ServerActionsTestOtherA-2051112331 None] attachment_update completed successfully. Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Flow 'volume_create_manager' (4200636f-054e-414a-852c-8c2ed86aa51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc68d6f-9e92-46d2-8a77-418801423fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc68d6f-9e92-46d2-8a77-418801423fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1535668133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7b26e6-303b-4ad2-aa98-bb7a31810106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a5bd815b555452d8732045db62b4105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:53Z,use_quota=True,user_id='fe06118f3e3946979109d2039981e356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84613563-9750-46a8-bca8-530a8cee6781),volume_type_id=84613563-9750-46a8-bca8-530a8cee6781)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f26873-f974-4dcb-9119-6b246bca8855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f26873-f974-4dcb-9119-6b246bca8855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468ccd87-ca82-4d12-aa26-1c42ec3ed9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468ccd87-ca82-4d12-aa26-1c42ec3ed9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7b26e6-303b-4ad2-aa98-bb7a31810106', 'volume_name': 'volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3e889d-7be7-4349-959d-7685924a4601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3e889d-7be7-4349-959d-7685924a4601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9cc097-4a77-48d7-9064-5344e0d8c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:53 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Volume 6c7b26e6-303b-4ad2-aa98-bb7a31810106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106', 'volume_size': 1} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1535668133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7b26e6-303b-4ad2-aa98-bb7a31810106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a5bd815b555452d8732045db62b4105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:40:53Z,use_quota=True,user_id='fe06118f3e3946979109d2039981e356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84613563-9750-46a8-bca8-530a8cee6781),volume_type_id=84613563-9750-46a8-bca8-530a8cee6781)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Creating volume 6c7b26e6-303b-4ad2-aa98-bb7a31810106 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:40:53 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:40:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:53 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 1073741824 Jul 18 05:40:53 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:54 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 1073741824" returned: 0 in 1.182s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:54 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 Jul 18 05:40:54 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:55 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106" returned: 0 in 0.735s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:40:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9cc097-4a77-48d7-9064-5344e0d8c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5d7ff-4d48-4bcb-bbcc-c6ce372df9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:40:55 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Volume volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 (6c7b26e6-303b-4ad2-aa98-bb7a31810106): created successfully Jul 18 05:40:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5d7ff-4d48-4bcb-bbcc-c6ce372df9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:40:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Flow 'volume_create_manager' (4200636f-054e-414a-852c-8c2ed86aa51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:40:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-272a7c4e-4a12-4f4c-b91f-793ca875af9d tempest-VolumeTypesAccessTest-1789164242 None] Created volume successfully. Jul 18 05:40:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Acquiring lock "cinder-6c7b26e6-303b-4ad2-aa98-bb7a31810106-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Lock "cinder-6c7b26e6-303b-4ad2-aa98-bb7a31810106-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Acquiring lock "cinder-quobyte-6c7b26e6-303b-4ad2-aa98-bb7a31810106" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:40:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Lock "cinder-quobyte-6c7b26e6-303b-4ad2-aa98-bb7a31810106" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:40:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[20117a4e-d703-4f37-8a07-490545e07aef]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:40:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:57 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 Jul 18 05:40:57 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:57 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106" returned: 0 in 0.736s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:57 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106 Jul 18 05:40:57 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:58 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6c7b26e6-303b-4ad2-aa98-bb7a31810106" returned: 0 in 0.553s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Lock "cinder-quobyte-6c7b26e6-303b-4ad2-aa98-bb7a31810106" released by "delete_volume" :: held 1.383s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:40:58 devstack cinder-volume[87497]: WARNING cinder.quota [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2010193947 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2010193947, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:40:58 devstack cinder-volume[87497]: WARNING cinder.quota [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2010193947 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2010193947, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Created reservations ['7c4bdf0a-8352-4f3d-8c61-cca6cef11043', 'b67be8f9-189a-4fb0-9789-0ab22a408901', 'c88e93a0-a527-40a3-836a-e310fb8af4b7', 'eb4d1c05-730b-4ed3-90fe-12388d76b004'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:40:58 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:40:58 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:40:58 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.310s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:40:58 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:40:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Deleted volume successfully. Jul 18 05:40:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-45e74fe5-7851-4051-aa1a-a15343a8aea2 tempest-VolumeTypesAccessTest-1789164242 None] Lock "cinder-6c7b26e6-303b-4ad2-aa98-bb7a31810106-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Flow 'volume_create_manager' (1e3d6a5a-6d8b-4227-8ffa-454a842f2506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c77a2ec-db60-4038-8b6d-3bc37f634d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c77a2ec-db60-4038-8b6d-3bc37f634d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-555488510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4b58fa-3f83-439a-a5fe-0b948c270e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f646d377054b57beec17beb832d2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:04Z,use_quota=True,user_id='4299bf18aa8d47c5b4dfcd4f88732b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c193e5-7241-426f-a2b7-f8447fb5710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c193e5-7241-426f-a2b7-f8447fb5710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd83a741-a2da-483d-b220-b45f00732c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd83a741-a2da-483d-b220-b45f00732c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4b58fa-3f83-439a-a5fe-0b948c270e12', 'volume_name': 'volume-af4b58fa-3f83-439a-a5fe-0b948c270e12', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3df566b-7816-4469-b550-494901f0f6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3df566b-7816-4469-b550-494901f0f6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30907327-e51e-4339-9de2-6929d2650da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:03 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Volume af4b58fa-3f83-439a-a5fe-0b948c270e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4b58fa-3f83-439a-a5fe-0b948c270e12', 'volume_size': 1} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-555488510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4b58fa-3f83-439a-a5fe-0b948c270e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f646d377054b57beec17beb832d2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:04Z,use_quota=True,user_id='4299bf18aa8d47c5b4dfcd4f88732b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Creating volume af4b58fa-3f83-439a-a5fe-0b948c270e12 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:41:03 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:41:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:03 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 1073741824 Jul 18 05:41:03 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:04 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 1073741824" returned: 0 in 1.078s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:05 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 Jul 18 05:41:05 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:05 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12" returned: 0 in 0.371s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:41:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30907327-e51e-4339-9de2-6929d2650da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4b58fa-3f83-439a-a5fe-0b948c270e12', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b13e0a9-5c17-47bf-b75d-e868b8cde557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:05 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Volume volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 (af4b58fa-3f83-439a-a5fe-0b948c270e12): created successfully Jul 18 05:41:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b13e0a9-5c17-47bf-b75d-e868b8cde557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Flow 'volume_create_manager' (1e3d6a5a-6d8b-4227-8ffa-454a842f2506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6f579f33-ae51-4a8d-8045-5c019ba2c8ff tempest-ServerRescueNegativeTestJSON-1150108243 None] Created volume successfully. Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:06 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:41:06 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:06 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.431s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 8 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:41:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:41:15 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=51,cinder:UPDATE=56,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:41:15 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=51,cinder:INSERT=11,cinder:UPDATE=65,cinder:DELETE=5 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:41:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Acquiring lock "cinder-af4b58fa-3f83-439a-a5fe-0b948c270e12-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "cinder-af4b58fa-3f83-439a-a5fe-0b948c270e12-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Acquiring lock "cinder-quobyte-af4b58fa-3f83-439a-a5fe-0b948c270e12" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "cinder-quobyte-af4b58fa-3f83-439a-a5fe-0b948c270e12" acquired by "delete_volume" :: waited 0.046s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a05d143-14d5-4b14-98a7-1e9b8800f8fa]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:41:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:20 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 Jul 18 05:41:20 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:21 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12" returned: 0 in 0.760s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:21 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12 Jul 18 05:41:21 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:21 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-af4b58fa-3f83-439a-a5fe-0b948c270e12" returned: 0 in 0.537s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "cinder-quobyte-af4b58fa-3f83-439a-a5fe-0b948c270e12" released by "delete_volume" :: held 1.426s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:21 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Created reservations ['cc088611-69d0-44c9-9b80-c5305e79e554', '55024688-a834-452a-bf99-5c4a4b47d98c', '36223e4e-d3b3-4536-9bcc-205391956406', '0a55a7a5-755f-400e-aaea-5293017905ec'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:41:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:22 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:41:22 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:22 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.350s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:22 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:41:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Deleted volume successfully. Jul 18 05:41:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-37f2ae68-bb39-4373-8ea9-2022d3dc6fee tempest-ServerRescueNegativeTestJSON-1150108243 None] Lock "cinder-af4b58fa-3f83-439a-a5fe-0b948c270e12-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-a0b1b5e6-0da7-4a34-9761-a7373a9d65d8 req-54466562-f16f-4975-86ee-0f4797f1b8ac tempest-ServerActionsTestOtherA-2051112331 None] Terminate volume connection completed successfully. Jul 18 05:41:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-a0b1b5e6-0da7-4a34-9761-a7373a9d65d8 req-54466562-f16f-4975-86ee-0f4797f1b8ac tempest-ServerActionsTestOtherA-2051112331 None] Deleting attachment 2e997ccc-0aa7-4ca9-875f-4f16f367dc68. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Flow 'volume_create_manager' (d6c4fcd8-e4ed-4988-9fd2-4efe32822576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c015b7-1f37-468f-81d2-00d49b86c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c015b7-1f37-468f-81d2-00d49b86c009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1636276033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0218386-aa14-45e1-8ecf-112fde9e2840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9719244bde4331bcb7f6ac4f75753b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:32Z,use_quota=True,user_id='881b4f64ef1b49c089cfe2093a14036d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310b78e1-64de-48a2-9801-bfd7d54d81e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310b78e1-64de-48a2-9801-bfd7d54d81e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782440f0-fdda-4de9-8998-8ef42a191c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782440f0-fdda-4de9-8998-8ef42a191c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0218386-aa14-45e1-8ecf-112fde9e2840', 'volume_name': 'volume-a0218386-aa14-45e1-8ecf-112fde9e2840', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85069db6-1564-4206-b9fb-6a873d36ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85069db6-1564-4206-b9fb-6a873d36ae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0be76fc-402f-45ab-a831-fd19e53a9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Volume a0218386-aa14-45e1-8ecf-112fde9e2840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0218386-aa14-45e1-8ecf-112fde9e2840', 'volume_size': 1} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1636276033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0218386-aa14-45e1-8ecf-112fde9e2840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d9719244bde4331bcb7f6ac4f75753b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:32Z,use_quota=True,user_id='881b4f64ef1b49c089cfe2093a14036d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Creating volume a0218386-aa14-45e1-8ecf-112fde9e2840 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:41:32 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:32 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840 1073741824 Jul 18 05:41:32 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:32 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840 1073741824" returned: 0 in 0.559s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:32 devstack sudo[92145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840 Jul 18 05:41:32 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:33 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840" returned: 0 in 0.337s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:41:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0be76fc-402f-45ab-a831-fd19e53a9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0218386-aa14-45e1-8ecf-112fde9e2840', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf01d52-a17e-4177-92d6-d069d6d49c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:33 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Volume volume-a0218386-aa14-45e1-8ecf-112fde9e2840 (a0218386-aa14-45e1-8ecf-112fde9e2840): created successfully Jul 18 05:41:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf01d52-a17e-4177-92d6-d069d6d49c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Flow 'volume_create_manager' (d6c4fcd8-e4ed-4988-9fd2-4efe32822576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-be6f485f-67b1-4137-a8db-a2eee768a03f tempest-AbsoluteLimitsTests-1072283426 None] Created volume successfully. Jul 18 05:41:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Acquiring lock "cinder-a0218386-aa14-45e1-8ecf-112fde9e2840-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Lock "cinder-a0218386-aa14-45e1-8ecf-112fde9e2840-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Acquiring lock "cinder-quobyte-a0218386-aa14-45e1-8ecf-112fde9e2840" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Lock "cinder-quobyte-a0218386-aa14-45e1-8ecf-112fde9e2840" acquired by "delete_volume" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:34 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[69517f41-8c68-4c93-bf9d-7a7f0eea6d4e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:41:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:34 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840 Jul 18 05:41:34 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:35 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840" returned: 0 in 0.588s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:35 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840 Jul 18 05:41:35 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:35 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a0218386-aa14-45e1-8ecf-112fde9e2840" returned: 0 in 0.303s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Lock "cinder-quobyte-a0218386-aa14-45e1-8ecf-112fde9e2840" released by "delete_volume" :: held 0.973s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Created reservations ['06bd169b-92fc-481a-a14d-395e034cc422', 'ba410d9b-e5a3-4efe-89ee-9d489910b564', '6c66cc6a-ecc1-4605-a2e1-dedf01dd9166', 'f4a6c436-8f96-491c-b3da-9878abaa7452'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:35 devstack sudo[92163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:41:35 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Acquiring lock "cinder-9b580def-9910-4572-a368-7078a2fe81c8-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Lock "cinder-9b580def-9910-4572-a368-7078a2fe81c8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Acquiring lock "cinder-quobyte-9b580def-9910-4572-a368-7078a2fe81c8" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Lock "cinder-quobyte-9b580def-9910-4572-a368-7078a2fe81c8" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a188eff1-042a-460d-99e2-9b53afe3d46e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:41:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:36 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.317s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:41:36 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Deleted volume successfully. Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e4caf2b-dbe7-41a5-9153-5cd08631632d tempest-AbsoluteLimitsTests-1072283426 None] Lock "cinder-a0218386-aa14-45e1-8ecf-112fde9e2840-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:36 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8 Jul 18 05:41:36 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:36 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8" returned: 0 in 0.451s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:36 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8 Jul 18 05:41:36 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:36 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9b580def-9910-4572-a368-7078a2fe81c8" returned: 0 in 0.301s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Lock "cinder-quobyte-9b580def-9910-4572-a368-7078a2fe81c8" released by "delete_volume" :: held 0.794s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Created reservations ['7b3340a7-e52e-48a7-a9a9-f433fa356866', '99a09da6-5c66-4074-a055-2ba96144e475', '5b94e547-e6b9-4e5d-96b4-a068be63a109', '74a0ece0-1649-4a3f-881c-0b44d8faa407'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:36 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:41:36 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:37 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.297s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:37 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:41:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Deleted volume successfully. Jul 18 05:41:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b63205db-b1c4-49b8-98ff-edda1ec78e96 tempest-ServerActionsTestOtherA-2051112331 None] Lock "cinder-9b580def-9910-4572-a368-7078a2fe81c8-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Flow 'volume_create_manager' (5b2a896d-33a7-4305-814e-5bcb8e5a3740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e61aac8-e3ca-424e-b28e-b731707b7b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e61aac8-e3ca-424e-b28e-b731707b7b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1025883389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91548341-87e6-487c-927b-79bce3ba67a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21c45724c784b63b276d12eb5314eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:43Z,use_quota=True,user_id='5925bcc3d0ac49318a1e113b34556142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179b9a46-651d-48ac-bbba-298e9fd93463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179b9a46-651d-48ac-bbba-298e9fd93463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d810599-217e-4464-967d-d1030692ab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d810599-217e-4464-967d-d1030692ab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91548341-87e6-487c-927b-79bce3ba67a1', 'volume_name': 'volume-91548341-87e6-487c-927b-79bce3ba67a1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43755b15-8150-4edf-ae72-19051e5b831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43755b15-8150-4edf-ae72-19051e5b831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da873052-10a9-4f76-b5ff-98f1a514528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:42 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Volume 91548341-87e6-487c-927b-79bce3ba67a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91548341-87e6-487c-927b-79bce3ba67a1', 'volume_size': 1} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1025883389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91548341-87e6-487c-927b-79bce3ba67a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21c45724c784b63b276d12eb5314eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:43Z,use_quota=True,user_id='5925bcc3d0ac49318a1e113b34556142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Creating volume 91548341-87e6-487c-927b-79bce3ba67a1 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:41:42 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:41:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:42 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1 1073741824 Jul 18 05:41:42 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:43 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1 1073741824" returned: 0 in 0.589s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:43 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1 Jul 18 05:41:43 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:43 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1" returned: 0 in 0.267s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:41:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da873052-10a9-4f76-b5ff-98f1a514528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91548341-87e6-487c-927b-79bce3ba67a1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab0b994-5dce-459d-bf5c-7050cb665556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:43 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Volume volume-91548341-87e6-487c-927b-79bce3ba67a1 (91548341-87e6-487c-927b-79bce3ba67a1): created successfully Jul 18 05:41:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab0b994-5dce-459d-bf5c-7050cb665556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Flow 'volume_create_manager' (5b2a896d-33a7-4305-814e-5bcb8e5a3740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d3d7edf8-89ed-4fff-ba8f-8cda31a3196e tempest-VolumesMetadataTest-1696603583 None] Created volume successfully. Jul 18 05:41:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Acquiring lock "cinder-91548341-87e6-487c-927b-79bce3ba67a1-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Lock "cinder-91548341-87e6-487c-927b-79bce3ba67a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Acquiring lock "cinder-quobyte-91548341-87e6-487c-927b-79bce3ba67a1" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Lock "cinder-quobyte-91548341-87e6-487c-927b-79bce3ba67a1" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a0142-af95-49e6-9b1c-19dc4828e9c3]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:41:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:46 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1 Jul 18 05:41:46 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:46 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1" returned: 0 in 0.500s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:46 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1 Jul 18 05:41:46 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:46 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-91548341-87e6-487c-927b-79bce3ba67a1" returned: 0 in 0.303s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Lock "cinder-quobyte-91548341-87e6-487c-927b-79bce3ba67a1" released by "delete_volume" :: held 0.873s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Created reservations ['fd7f600e-865f-4fa3-b6d5-75866271f42f', 'b4b54b8a-8cab-46cc-b192-696d76144212', '7329c33d-192c-4cb1-8856-3607ab3b559e', 'dbd615ab-6ebc-44a9-a38f-de1a2aa37df9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:46 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:41:46 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:47 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.362s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:47 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:41:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Deleted volume successfully. Jul 18 05:41:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05bf5c91-e646-4d21-973a-1339d1fcf0e3 tempest-VolumesMetadataTest-1696603583 None] Lock "cinder-91548341-87e6-487c-927b-79bce3ba67a1-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Flow 'volume_create_manager' (5e169f0b-cd2b-409e-83dc-8e2e80d1a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8876b0-3d0a-4be8-9e22-f185f56e7fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8876b0-3d0a-4be8-9e22-f185f56e7fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1731204485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e899bf-a9df-400a-b46f-4321d11b2ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d987cd48725d418b99c6abb181e82937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:51Z,use_quota=True,user_id='f5fe9e75ecbd40ff8caea9600a7a37ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c6a195-af19-45c5-9dc3-3f4870518d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c6a195-af19-45c5-9dc3-3f4870518d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4342c4f1-b1a8-453d-9a6a-f92160491a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4342c4f1-b1a8-453d-9a6a-f92160491a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e899bf-a9df-400a-b46f-4321d11b2ba3', 'volume_name': 'volume-19e899bf-a9df-400a-b46f-4321d11b2ba3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b054929-bd48-4671-ae11-d3b7dbbc720a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b054929-bd48-4671-ae11-d3b7dbbc720a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47d145c-78da-441f-8034-33e7d90fae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:51 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Volume 19e899bf-a9df-400a-b46f-4321d11b2ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e899bf-a9df-400a-b46f-4321d11b2ba3', 'volume_size': 1} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1731204485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e899bf-a9df-400a-b46f-4321d11b2ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d987cd48725d418b99c6abb181e82937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:51Z,use_quota=True,user_id='f5fe9e75ecbd40ff8caea9600a7a37ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Creating volume 19e899bf-a9df-400a-b46f-4321d11b2ba3 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:41:51 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:51 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 1073741824 Jul 18 05:41:51 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:51 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 1073741824" returned: 0 in 0.545s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:52 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 Jul 18 05:41:52 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:52 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3" returned: 0 in 0.466s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:41:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47d145c-78da-441f-8034-33e7d90fae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e899bf-a9df-400a-b46f-4321d11b2ba3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fd34cc-4194-4876-88ac-3636137d6c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:52 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Volume volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 (19e899bf-a9df-400a-b46f-4321d11b2ba3): created successfully Jul 18 05:41:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fd34cc-4194-4876-88ac-3636137d6c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Flow 'volume_create_manager' (5e169f0b-cd2b-409e-83dc-8e2e80d1a79e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d0e548e2-cee8-43e8-b9dd-2a9e229f3cad tempest-AttachVolumeShelveTestJSON-130051479 None] Created volume successfully. Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Flow 'volume_create_manager' (deff44ae-21ee-4ee6-9835-a5d81fce9bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd72b1c5-b667-421d-8e9b-6d18870f907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd72b1c5-b667-421d-8e9b-6d18870f907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1128465962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5920bceb-bbe7-42ab-9462-75ceff8d2369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4332566f32874d32a2f36bfe1287669d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:54Z,use_quota=True,user_id='6160bf867d9443da9a1238877eb43d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3c01db-4398-4f56-9601-87a32741e863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3c01db-4398-4f56-9601-87a32741e863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f81ad1-4732-4735-9b92-95eaf57ebf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f81ad1-4732-4735-9b92-95eaf57ebf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5920bceb-bbe7-42ab-9462-75ceff8d2369', 'volume_name': 'volume-5920bceb-bbe7-42ab-9462-75ceff8d2369', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47927f3b-8794-4a4c-a2b9-5b3d9876135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47927f3b-8794-4a4c-a2b9-5b3d9876135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11897bc8-344e-4ad3-9179-2e33e3f0d7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:53 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Volume 5920bceb-bbe7-42ab-9462-75ceff8d2369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5920bceb-bbe7-42ab-9462-75ceff8d2369', 'volume_size': 1} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1128465962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5920bceb-bbe7-42ab-9462-75ceff8d2369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4332566f32874d32a2f36bfe1287669d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:41:54Z,use_quota=True,user_id='6160bf867d9443da9a1238877eb43d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Creating volume 5920bceb-bbe7-42ab-9462-75ceff8d2369 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:41:53 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:41:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:53 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 1073741824 Jul 18 05:41:53 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:54 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 1073741824" returned: 0 in 0.618s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:54 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 Jul 18 05:41:54 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:54 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369" returned: 0 in 0.405s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:41:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11897bc8-344e-4ad3-9179-2e33e3f0d7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5920bceb-bbe7-42ab-9462-75ceff8d2369', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75e1c19-6b4d-4ea0-99d0-1e83bb716d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:41:54 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Volume volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 (5920bceb-bbe7-42ab-9462-75ceff8d2369): created successfully Jul 18 05:41:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75e1c19-6b4d-4ea0-99d0-1e83bb716d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:41:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Flow 'volume_create_manager' (deff44ae-21ee-4ee6-9835-a5d81fce9bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:41:54 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-81af5fb4-6ed0-4b86-b2b7-7aa57dbbfded tempest-VolumesTransfersTest-1020441288 None] Created volume successfully. Jul 18 05:41:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e75c1f02-aceb-479e-a98c-f1521e715821 tempest-VolumesTransfersTest-923962735 None] Transfer volume completed successfully. Jul 18 05:41:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Acquiring lock "cinder-5920bceb-bbe7-42ab-9462-75ceff8d2369-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Lock "cinder-5920bceb-bbe7-42ab-9462-75ceff8d2369-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Acquiring lock "cinder-quobyte-5920bceb-bbe7-42ab-9462-75ceff8d2369" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:41:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Lock "cinder-quobyte-5920bceb-bbe7-42ab-9462-75ceff8d2369" acquired by "delete_volume" :: waited 0.044s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:41:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a118579c-1bf2-48e4-b618-6f89336d61f5]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:41:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:57 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 Jul 18 05:41:57 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:58 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369" returned: 0 in 0.637s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:58 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369 Jul 18 05:41:58 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:58 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-5920bceb-bbe7-42ab-9462-75ceff8d2369" returned: 0 in 0.327s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Lock "cinder-quobyte-5920bceb-bbe7-42ab-9462-75ceff8d2369" released by "delete_volume" :: held 1.029s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Created reservations ['821e05e2-1934-49ea-8228-1017b2e473a2', 'd69ac1d3-8b97-4619-8dde-7ef43e485c7e', '5ed5a9ed-8ed2-44a3-b0b3-3fccf59c0d65', '8f0aeeec-43bb-43cf-a9f6-db66ceedefde'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:41:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:41:58 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:41:58 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:41:59 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Jul 18 05:41:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.355s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:41:59 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:41:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Deleted volume successfully. Jul 18 05:41:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a72b4ba-fca2-44cb-8800-8fee7d63fb31 tempest-VolumesTransfersTest-298374975 None] Lock "cinder-5920bceb-bbe7-42ab-9462-75ceff8d2369-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:42:00 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Flow 'volume_create_manager' (628fa3ac-7af1-40bb-822a-a26db9a6f74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877b579e-e612-46b2-8ad1-16ca07421d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877b579e-e612-46b2-8ad1-16ca07421d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1963439097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89eacbe-6d09-48a6-b878-9929decbd622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4332566f32874d32a2f36bfe1287669d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:01Z,use_quota=True,user_id='6160bf867d9443da9a1238877eb43d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fe45cc-05b9-4d26-8467-80dd9e6ab1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fe45cc-05b9-4d26-8467-80dd9e6ab1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e369fa-3a32-4cfa-86c0-23b2ee8004d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e369fa-3a32-4cfa-86c0-23b2ee8004d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89eacbe-6d09-48a6-b878-9929decbd622', 'volume_name': 'volume-e89eacbe-6d09-48a6-b878-9929decbd622', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53884577-9a29-4d05-a75d-4c15ec9645db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53884577-9a29-4d05-a75d-4c15ec9645db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522b5c2e-5d35-4ed7-9762-5363628d9124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:01 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Volume e89eacbe-6d09-48a6-b878-9929decbd622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89eacbe-6d09-48a6-b878-9929decbd622', 'volume_size': 1} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1963439097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89eacbe-6d09-48a6-b878-9929decbd622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4332566f32874d32a2f36bfe1287669d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:01Z,use_quota=True,user_id='6160bf867d9443da9a1238877eb43d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Creating volume e89eacbe-6d09-48a6-b878-9929decbd622 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:42:01 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:01 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622 1073741824 Jul 18 05:42:01 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:01 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622 1073741824" returned: 0 in 0.789s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:02 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622 Jul 18 05:42:02 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:02 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622" returned: 0 in 0.422s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:42:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522b5c2e-5d35-4ed7-9762-5363628d9124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89eacbe-6d09-48a6-b878-9929decbd622', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c2741c-00a9-45cd-adeb-12567b84942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:02 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Volume volume-e89eacbe-6d09-48a6-b878-9929decbd622 (e89eacbe-6d09-48a6-b878-9929decbd622): created successfully Jul 18 05:42:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c2741c-00a9-45cd-adeb-12567b84942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Flow 'volume_create_manager' (628fa3ac-7af1-40bb-822a-a26db9a6f74a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8da55f2b-8650-4514-be0e-8f0d6e91fb7e tempest-VolumesTransfersTest-1020441288 None] Created volume successfully. Jul 18 05:42:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Acquiring lock "cinder-e89eacbe-6d09-48a6-b878-9929decbd622-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:42:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Lock "cinder-e89eacbe-6d09-48a6-b878-9929decbd622-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:42:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Acquiring lock "cinder-quobyte-e89eacbe-6d09-48a6-b878-9929decbd622" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:42:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Lock "cinder-quobyte-e89eacbe-6d09-48a6-b878-9929decbd622" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:42:03 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e24d24-f505-4d42-83bd-89380e4407fd]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:42:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:03 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622 Jul 18 05:42:03 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:04 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622" returned: 0 in 0.738s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:04 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622 Jul 18 05:42:04 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:04 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e89eacbe-6d09-48a6-b878-9929decbd622" returned: 0 in 0.413s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Lock "cinder-quobyte-e89eacbe-6d09-48a6-b878-9929decbd622" released by "delete_volume" :: held 1.222s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Created reservations ['8d508984-89da-40d5-b25d-daed281d1469', '50971ffb-68ab-4174-b070-4e8c05b0f13e', '39ddc6f7-592f-47c8-869e-e08ae8d90dd1', '8c82d20f-77cf-47ea-9ac4-fc0d056ba0b0'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:05 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:42:05 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:05 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.501s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:42:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Deleted volume successfully. Jul 18 05:42:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7ac91a8f-bcd9-400d-8679-fe2045a61399 tempest-VolumesTransfersTest-298374975 None] Lock "cinder-e89eacbe-6d09-48a6-b878-9929decbd622-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:06 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:42:06 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:06 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.609s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 8 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:42:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:42:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-8aa25089-6c48-4d3c-a2a0-9e5338bef094 req-b6339f28-8193-460a-afdf-d070a21cc193 tempest-AttachVolumeShelveTestJSON-130051479 None] No connector for attachment 148f411b-7d12-4442-974f-39aadc569308; skipping storage backend terminate_connection call. {{(pid=87497) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 18 05:42:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-8aa25089-6c48-4d3c-a2a0-9e5338bef094 req-b6339f28-8193-460a-afdf-d070a21cc193 tempest-AttachVolumeShelveTestJSON-130051479 None] Deleting attachment 148f411b-7d12-4442-974f-39aadc569308. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=62,cinder:SELECT=40,cinder:INSERT=10,cinder:DELETE=6 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=47,cinder:UPDATE=66,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Flow 'volume_create_manager' (a8d5ec27-37a1-4586-a52c-23b524adff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3236cf5-cfc6-44e5-9383-ecb8d4c5d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3236cf5-cfc6-44e5-9383-ecb8d4c5d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-194173271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef85164d-a325-4004-accc-cb0c35f002aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54074e3c3abb43008096a1021d8a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:19Z,use_quota=True,user_id='29df3040b1cd4304bca5799c966ca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10d36de-3239-46b4-b5d3-3804f4060bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10d36de-3239-46b4-b5d3-3804f4060bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033d8d7f-4ed2-419c-9e44-58243ce4772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033d8d7f-4ed2-419c-9e44-58243ce4772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef85164d-a325-4004-accc-cb0c35f002aa', 'volume_name': 'volume-ef85164d-a325-4004-accc-cb0c35f002aa', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c241d9-2b0e-4a50-9461-6ee60c65c0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c241d9-2b0e-4a50-9461-6ee60c65c0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81464e57-e87f-4121-86a3-f1d9ce9869d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Volume ef85164d-a325-4004-accc-cb0c35f002aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef85164d-a325-4004-accc-cb0c35f002aa', 'volume_size': 1} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-194173271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef85164d-a325-4004-accc-cb0c35f002aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54074e3c3abb43008096a1021d8a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:19Z,use_quota=True,user_id='29df3040b1cd4304bca5799c966ca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Creating volume ef85164d-a325-4004-accc-cb0c35f002aa {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:42:18 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:42:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:18 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa 1073741824 Jul 18 05:42:18 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:19 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa 1073741824" returned: 0 in 0.507s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:19 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa Jul 18 05:42:19 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:19 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:42:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81464e57-e87f-4121-86a3-f1d9ce9869d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef85164d-a325-4004-accc-cb0c35f002aa', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad22049-899a-4d2f-b4bd-678f822facf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:19 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Volume volume-ef85164d-a325-4004-accc-cb0c35f002aa (ef85164d-a325-4004-accc-cb0c35f002aa): created successfully Jul 18 05:42:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad22049-899a-4d2f-b4bd-678f822facf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Flow 'volume_create_manager' (a8d5ec27-37a1-4586-a52c-23b524adff48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-70976039-67e4-4ad8-a62f-4cb80bc6b2cc tempest-VolumesTransfersV355Test-426455666 None] Created volume successfully. Jul 18 05:42:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-03601976-d7d1-41f3-83de-3f8bd7ddbc6e tempest-VolumesTransfersV355Test-873558731 None] Transfer volume completed successfully. Jul 18 05:42:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Acquiring lock "cinder-ef85164d-a325-4004-accc-cb0c35f002aa-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:42:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Lock "cinder-ef85164d-a325-4004-accc-cb0c35f002aa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:42:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Acquiring lock "cinder-quobyte-ef85164d-a325-4004-accc-cb0c35f002aa" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:42:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Lock "cinder-quobyte-ef85164d-a325-4004-accc-cb0c35f002aa" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:42:23 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b5873-2993-4aa6-9017-7661234edab6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:42:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:23 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa Jul 18 05:42:23 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:23 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa" returned: 0 in 0.688s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:23 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa Jul 18 05:42:23 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:24 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ef85164d-a325-4004-accc-cb0c35f002aa" returned: 0 in 0.515s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Lock "cinder-quobyte-ef85164d-a325-4004-accc-cb0c35f002aa" released by "delete_volume" :: held 1.316s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:42:24 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Created reservations ['e8bf34a8-bee4-4859-82e2-d6843713cbfd', 'ab07a0a4-4564-4544-94be-95cfef77c71d', '4835a38b-3207-49ad-8298-888ac2161c02', '93af7ef8-0686-4aa2-a53a-9d603241eed9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:42:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:24 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:42:24 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:25 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.537s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:25 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:42:25 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Deleted volume successfully. Jul 18 05:42:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6550123f-6ab1-4c1f-9dd3-6275c8faeab2 tempest-VolumesTransfersV355Test-696147490 None] Lock "cinder-ef85164d-a325-4004-accc-cb0c35f002aa-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Flow 'volume_create_manager' (99a757f7-29bf-481a-af4c-d5468ad95d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3929630-081b-4b70-881b-df12d82ad6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3929630-081b-4b70-881b-df12d82ad6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-143340422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acad127b-8598-4cb5-9c87-47ac0dd9f4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54074e3c3abb43008096a1021d8a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:27Z,use_quota=True,user_id='29df3040b1cd4304bca5799c966ca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7771b59-62f9-4f28-b97f-33dc89111845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7771b59-62f9-4f28-b97f-33dc89111845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0777c2b3-60ef-4cdd-a412-41b14fe50cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0777c2b3-60ef-4cdd-a412-41b14fe50cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acad127b-8598-4cb5-9c87-47ac0dd9f4c7', 'volume_name': 'volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bc7959-5c54-484b-8945-983a99316e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bc7959-5c54-484b-8945-983a99316e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72670aac-291e-4a78-b8d0-8b23eac7cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:26 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Volume acad127b-8598-4cb5-9c87-47ac0dd9f4c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7', 'volume_size': 1} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-143340422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acad127b-8598-4cb5-9c87-47ac0dd9f4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54074e3c3abb43008096a1021d8a23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:27Z,use_quota=True,user_id='29df3040b1cd4304bca5799c966ca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Creating volume acad127b-8598-4cb5-9c87-47ac0dd9f4c7 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:42:26 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:42:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:26 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 1073741824 Jul 18 05:42:26 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:27 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 1073741824" returned: 0 in 0.829s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:27 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 Jul 18 05:42:27 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:27 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7" returned: 0 in 0.347s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:42:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72670aac-291e-4a78-b8d0-8b23eac7cf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3c0c1-9ed8-47ed-bdc0-b747ac05dec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:28 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Volume volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 (acad127b-8598-4cb5-9c87-47ac0dd9f4c7): created successfully Jul 18 05:42:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3c0c1-9ed8-47ed-bdc0-b747ac05dec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Flow 'volume_create_manager' (99a757f7-29bf-481a-af4c-d5468ad95d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:28 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ec51b70b-43f5-40f6-9e13-704f27d98611 tempest-VolumesTransfersV355Test-426455666 None] Created volume successfully. Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Acquiring lock "cinder-acad127b-8598-4cb5-9c87-47ac0dd9f4c7-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Lock "cinder-acad127b-8598-4cb5-9c87-47ac0dd9f4c7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Flow 'volume_create_manager' (7b7ba363-4302-4aa6-9716-fd7eda4f8014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363e8522-2625-4f45-a2e8-ec8d486e6b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363e8522-2625-4f45-a2e8-ec8d486e6b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-28746137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191f002b-3bb3-4db8-ae3a-a50d5ea35fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21b8b48e074f20bd893b0f43484099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:29Z,use_quota=True,user_id='d37ba7036b574354845e90ec62f0b024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6b5352-c15a-4bc9-9034-ed2324247f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6b5352-c15a-4bc9-9034-ed2324247f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1445b1-5d60-464a-882f-cac3505529cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1445b1-5d60-464a-882f-cac3505529cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191f002b-3bb3-4db8-ae3a-a50d5ea35fa5', 'volume_name': 'volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36543a63-e759-4b9e-9247-825dc9b25524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36543a63-e759-4b9e-9247-825dc9b25524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefb8b2b-d492-487b-ac32-c2a6f9b78d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:29 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Volume 191f002b-3bb3-4db8-ae3a-a50d5ea35fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5', 'volume_size': 1} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-28746137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191f002b-3bb3-4db8-ae3a-a50d5ea35fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21b8b48e074f20bd893b0f43484099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:29Z,use_quota=True,user_id='d37ba7036b574354845e90ec62f0b024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Creating volume 191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:42:29 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Acquiring lock "cinder-quobyte-acad127b-8598-4cb5-9c87-47ac0dd9f4c7" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:42:29 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 1073741824 Jul 18 05:42:29 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Lock "cinder-quobyte-acad127b-8598-4cb5-9c87-47ac0dd9f4c7" acquired by "delete_volume" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[391625f7-d44c-4d8e-a5e7-01d3dd2af72e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:42:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:29 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 Jul 18 05:42:29 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:30 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 1073741824" returned: 0 in 0.603s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:30 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7" returned: 0 in 0.526s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:30 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7 Jul 18 05:42:30 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:30 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 Jul 18 05:42:30 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:30 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acad127b-8598-4cb5-9c87-47ac0dd9f4c7" returned: 0 in 0.368s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Lock "cinder-quobyte-acad127b-8598-4cb5-9c87-47ac0dd9f4c7" released by "delete_volume" :: held 0.964s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:42:30 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5" returned: 0 in 0.370s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefb8b2b-d492-487b-ac32-c2a6f9b78d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2565a647-20b0-4c4e-9a6d-456bf5c72b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:30 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Volume volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 (191f002b-3bb3-4db8-ae3a-a50d5ea35fa5): created successfully Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2565a647-20b0-4c4e-9a6d-456bf5c72b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Flow 'volume_create_manager' (7b7ba363-4302-4aa6-9716-fd7eda4f8014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-70d3d29f-4e19-45bb-aa18-be0f689a8f23 tempest-AttachVolumeNegativeTest-1948277789 None] Created volume successfully. Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Created reservations ['2d543fec-02de-41b6-97fb-bab805fed599', '5506501c-a4ac-4c21-aa3a-143335047996', '304654a1-dfd7-44b0-b74d-56bbc5c1ca55', 'd8d428bd-5f6b-4490-9666-9825202c8f74'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:30 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:42:30 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:30 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.258s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:42:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Deleted volume successfully. Jul 18 05:42:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-29817b4c-288f-47d6-9eac-694d121b1d6d tempest-VolumesTransfersV355Test-696147490 None] Lock "cinder-acad127b-8598-4cb5-9c87-47ac0dd9f4c7-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:42:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-96ada158-8bb0-46f2-866f-0f4c20271ce0 req-d9bb02f5-1a19-4643-947e-7627bba85181 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-96ada158-8bb0-46f2-866f-0f4c20271ce0 req-d9bb02f5-1a19-4643-947e-7627bba85181 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-96ada158-8bb0-46f2-866f-0f4c20271ce0 req-d9bb02f5-1a19-4643-947e-7627bba85181 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-96ada158-8bb0-46f2-866f-0f4c20271ce0 req-d9bb02f5-1a19-4643-947e-7627bba85181 tempest-AttachVolumeNegativeTest-1948277789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0730c3b5-2b39-4a98-bddf-2d245a42ffb4', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:42:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-96ada158-8bb0-46f2-866f-0f4c20271ce0 req-d9bb02f5-1a19-4643-947e-7627bba85181 tempest-AttachVolumeNegativeTest-1948277789 None] attachment_update completed successfully. Jul 18 05:42:38 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:42:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Flow 'volume_create_manager' (44a41da9-b3be-4478-b73d-22c242160d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0605636c-dcfc-4907-8563-29bfbb1cedc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0605636c-dcfc-4907-8563-29bfbb1cedc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1494935861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b64d7b0-6eae-4c89-8966-19db7271b1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056c7834ecab4f8cab041939e989e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:39Z,use_quota=True,user_id='77535fad7d26477b9cc4925d802b83fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8797307d-f981-47d0-bd32-d1155ad1a89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8797307d-f981-47d0-bd32-d1155ad1a89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6145690e-2230-48e2-aea3-34483ad60b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6145690e-2230-48e2-aea3-34483ad60b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b64d7b0-6eae-4c89-8966-19db7271b1c3', 'volume_name': 'volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f64917-4879-4c9f-aa69-2d964e0a6bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f64917-4879-4c9f-aa69-2d964e0a6bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffe1624-cacf-41fd-bb56-ba205465f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:39 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Volume 8b64d7b0-6eae-4c89-8966-19db7271b1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3', 'volume_size': 1} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1494935861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b64d7b0-6eae-4c89-8966-19db7271b1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056c7834ecab4f8cab041939e989e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:39Z,use_quota=True,user_id='77535fad7d26477b9cc4925d802b83fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Creating volume 8b64d7b0-6eae-4c89-8966-19db7271b1c3 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:42:39 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:39 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 1073741824 Jul 18 05:42:39 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:39 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 1073741824" returned: 0 in 0.521s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:39 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 Jul 18 05:42:39 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:39 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3" returned: 0 in 0.318s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffe1624-cacf-41fd-bb56-ba205465f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c67b40-7426-4270-89bb-8ed8ebeb96f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:40 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Volume volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 (8b64d7b0-6eae-4c89-8966-19db7271b1c3): created successfully Jul 18 05:42:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c67b40-7426-4270-89bb-8ed8ebeb96f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Flow 'volume_create_manager' (44a41da9-b3be-4478-b73d-22c242160d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-78f60ee5-2da2-4ecb-8900-36c6bbe74207 tempest-VolumesNegativeTest-764715986 None] Created volume successfully. Jul 18 05:42:47 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:42:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Flow 'volume_create_manager' (5a7ecf7d-c831-4bce-b217-f1882dff8b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bd544c-9ae4-41af-ace2-9a63de94bba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bd544c-9ae4-41af-ace2-9a63de94bba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1319644679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437eeaef-031e-4fdf-b92b-e6d97979b3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de092f296db2409e87fa257dd20c66e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:48Z,use_quota=True,user_id='ca64b221b701499a8068050d68b72b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33539336-14dc-4bb4-a129-482a7e1f27cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33539336-14dc-4bb4-a129-482a7e1f27cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe1659f-0bcd-4d87-9221-ab9cc7d28a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe1659f-0bcd-4d87-9221-ab9cc7d28a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437eeaef-031e-4fdf-b92b-e6d97979b3d9', 'volume_name': 'volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed66ec4-077a-40cd-8b76-8c8780563ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed66ec4-077a-40cd-8b76-8c8780563ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821acaec-040c-4664-89f4-b355db3fd986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:48 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Volume 437eeaef-031e-4fdf-b92b-e6d97979b3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9', 'volume_size': 1} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1319644679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437eeaef-031e-4fdf-b92b-e6d97979b3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de092f296db2409e87fa257dd20c66e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:42:48Z,use_quota=True,user_id='ca64b221b701499a8068050d68b72b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Creating volume 437eeaef-031e-4fdf-b92b-e6d97979b3d9 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:42:48 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:42:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:48 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 1073741824 Jul 18 05:42:48 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:49 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 1073741824" returned: 0 in 1.131s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:42:49 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 Jul 18 05:42:49 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:42:49 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Jul 18 05:42:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9" returned: 0 in 0.605s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:42:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:42:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821acaec-040c-4664-89f4-b355db3fd986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae3b48c-0a38-4a2e-9a77-dcca26388d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:42:50 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Volume volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 (437eeaef-031e-4fdf-b92b-e6d97979b3d9): created successfully Jul 18 05:42:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae3b48c-0a38-4a2e-9a77-dcca26388d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:42:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Flow 'volume_create_manager' (5a7ecf7d-c831-4bce-b217-f1882dff8b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:42:50 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9fe111e5-af6d-484b-aa80-e5be53a411bf tempest-AttachVolumeTestJSON-2089319826 None] Created volume successfully. Jul 18 05:42:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-f8e4ec1a-08bd-4ab8-80c9-63d68f1fc08e req-644312d4-0bca-49ac-929e-3c1ede2e25dd tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:42:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-f8e4ec1a-08bd-4ab8-80c9-63d68f1fc08e req-644312d4-0bca-49ac-929e-3c1ede2e25dd tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:42:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-f8e4ec1a-08bd-4ab8-80c9-63d68f1fc08e req-644312d4-0bca-49ac-929e-3c1ede2e25dd tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:42:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-f8e4ec1a-08bd-4ab8-80c9-63d68f1fc08e req-644312d4-0bca-49ac-929e-3c1ede2e25dd tempest-AttachVolumeTestJSON-2089319826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d0185e4-5ba0-4df8-a292-75446ab9d687', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:42:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-f8e4ec1a-08bd-4ab8-80c9-63d68f1fc08e req-644312d4-0bca-49ac-929e-3c1ede2e25dd tempest-AttachVolumeTestJSON-2089319826 None] attachment_update completed successfully. Jul 18 05:43:03 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=35,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:43:03 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=41,cinder:DELETE=5,cinder:SELECT=31,cinder:INSERT=8 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Acquiring lock "cinder-8b64d7b0-6eae-4c89-8966-19db7271b1c3-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Lock "cinder-8b64d7b0-6eae-4c89-8966-19db7271b1c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Acquiring lock "cinder-quobyte-8b64d7b0-6eae-4c89-8966-19db7271b1c3" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Lock "cinder-quobyte-8b64d7b0-6eae-4c89-8966-19db7271b1c3" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f364474a-4eea-492d-a649-2ac448fd4a76]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:04 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 Jul 18 05:43:04 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:04 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3" returned: 0 in 0.369s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:04 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3 Jul 18 05:43:04 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:04 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8b64d7b0-6eae-4c89-8966-19db7271b1c3" returned: 0 in 0.270s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Lock "cinder-quobyte-8b64d7b0-6eae-4c89-8966-19db7271b1c3" released by "delete_volume" :: held 0.681s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:04 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Created reservations ['89c50e28-9bf1-4b27-91de-e0fdabccd9d4', 'e3961ce6-2066-479f-abed-509055c4ae20', '89b1a925-bdc5-4e1b-a4f7-ef427f6f8b50', '293e8cce-9943-452e-9e4f-80bed7006b68'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:43:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:05 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:43:05 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:05 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.302s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:05 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:43:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Deleted volume successfully. Jul 18 05:43:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85ac99d3-bedc-4d25-9e38-ac032e27599d tempest-VolumesNegativeTest-764715986 None] Lock "cinder-8b64d7b0-6eae-4c89-8966-19db7271b1c3-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:06 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:43:06 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:06 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.355s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 8 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:43:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Flow 'volume_create_manager' (568c9ac3-0804-40a5-9706-942567a1eeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9a98d3-7a9a-40cf-a245-c9d90626769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9a98d3-7a9a-40cf-a245-c9d90626769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1542234739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8c2d07-decf-4d8d-b7be-1916783e4b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f31f2ccb054bc29413d94d79716ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:43:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:43:09Z,use_quota=True,user_id='72840918806a4170a202a137b2349dd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93a22b1-9282-4698-a9cc-fc3c0ebf3f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93a22b1-9282-4698-a9cc-fc3c0ebf3f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4a0089-10b4-4469-b645-28c2eb6652f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4a0089-10b4-4469-b645-28c2eb6652f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8c2d07-decf-4d8d-b7be-1916783e4b74', 'volume_name': 'volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74', 'volume_size': 2}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2170bbeb-b91a-4706-ac97-59881d14d0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2170bbeb-b91a-4706-ac97-59881d14d0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9340267b-15f3-4738-abbd-df6614291ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:09 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Volume 9d8c2d07-decf-4d8d-b7be-1916783e4b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74', 'volume_size': 2} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1542234739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8c2d07-decf-4d8d-b7be-1916783e4b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f31f2ccb054bc29413d94d79716ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:43:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:43:09Z,use_quota=True,user_id='72840918806a4170a202a137b2349dd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Creating volume 9d8c2d07-decf-4d8d-b7be-1916783e4b74 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:43:09 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:43:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 2147483648 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:09 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 2147483648 Jul 18 05:43:09 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:10 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 2147483648" returned: 0 in 0.558s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:10 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 Jul 18 05:43:10 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:10 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74" returned: 0 in 0.286s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9340267b-15f3-4738-abbd-df6614291ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74', 'volume_size': 2}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257be7c5-f82c-49c4-8407-538f3b4b46d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:10 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Volume volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 (9d8c2d07-decf-4d8d-b7be-1916783e4b74): created successfully Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257be7c5-f82c-49c4-8407-538f3b4b46d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Flow 'volume_create_manager' (568c9ac3-0804-40a5-9706-942567a1eeeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:43:10 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2ff16354-514c-447c-b1ef-d7d8c3bd29d6 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Created volume successfully. Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Acquiring lock "cinder-19e899bf-a9df-400a-b46f-4321d11b2ba3-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "cinder-19e899bf-a9df-400a-b46f-4321d11b2ba3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Acquiring lock "cinder-quobyte-19e899bf-a9df-400a-b46f-4321d11b2ba3" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "cinder-quobyte-19e899bf-a9df-400a-b46f-4321d11b2ba3" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bde733-4bcb-4eb7-a770-bb19e4159ff1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:10 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 Jul 18 05:43:10 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:11 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3" returned: 0 in 0.377s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:11 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3 Jul 18 05:43:11 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:11 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Creating offline snapshot 7ac42bec-f5cd-460d-a218-3001a68dbf8b of volume 9d8c2d07-decf-4d8d-b7be-1916783e4b74 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-19e899bf-a9df-400a-b46f-4321d11b2ba3" returned: 0 in 0.313s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "cinder-quobyte-19e899bf-a9df-400a-b46f-4321d11b2ba3" released by "delete_volume" :: held 0.733s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9872a04c-ff4f-41a8-adf9-159501a52ca3]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Created reservations ['3e9ca7e2-16f7-4e20-bb05-6b276853c896', '18044ab0-b662-455b-af38-f9f342cc1630', '54755ebc-060e-46ae-913a-d3b81557a0f8', 'f4ec3830-fa95-4b00-971c-e17aa1e0ce64'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:43:11 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 Jul 18 05:43:11 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:11 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:43:11 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:11 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74" returned: 0 in 0.441s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b 2G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:11 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b 2G Jul 18 05:43:11 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:11 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.337s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:11 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:43:12 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Deleted volume successfully. Jul 18 05:43:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8a41e693-e29f-449e-b15e-d541a8a6f586 tempest-AttachVolumeShelveTestJSON-130051479 None] Lock "cinder-19e899bf-a9df-400a-b46f-4321d11b2ba3-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:12 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b 2G" returned: 0 in 0.469s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:12 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b Jul 18 05:43:12 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:12 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b" returned: 0 in 0.322s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:12 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b is being set with open permissions: ugo+rw Jul 18 05:43:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:12 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b Jul 18 05:43:12 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:13 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b" returned: 0 in 0.351s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:13 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.info Jul 18 05:43:13 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:13 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.info" returned: 0 in 0.314s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:13 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.info is being set with open permissions: ugo+rw Jul 18 05:43:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:13 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.info Jul 18 05:43:13 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:13 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.info" returned: 0 in 0.442s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-872a39c1-0985-4e61-bc37-e6ad9d791483 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Create snapshot completed successfully Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Acquiring lock "cinder-7ac42bec-f5cd-460d-a218-3001a68dbf8b-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-7ac42bec-f5cd-460d-a218-3001a68dbf8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Acquiring lock "cinder-quobyte-9d8c2d07-decf-4d8d-b7be-1916783e4b74" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-quobyte-9d8c2d07-decf-4d8d-b7be-1916783e4b74" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Acquiring lock "cinder-quobyte-7ac42bec-f5cd-460d-a218-3001a68dbf8b" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-quobyte-7ac42bec-f5cd-460d-a218-3001a68dbf8b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Deleting offline snapshot 7ac42bec-f5cd-460d-a218-3001a68dbf8b of volume 9d8c2d07-decf-4d8d-b7be-1916783e4b74 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] snapshot_file for this snap is: volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64e1b4c-ea81-44d9-8045-a1ef43536436]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:15 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b Jul 18 05:43:15 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:15 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b" returned: 0 in 0.535s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:43:15 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[44502145-4697-4785-bf36-946b0ee4172d]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:15 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 Jul 18 05:43:15 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:15 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74" returned: 0 in 0.412s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:15 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b Jul 18 05:43:15 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:16 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b" returned: 0 in 0.374s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:16 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b Jul 18 05:43:16 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:16 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74.7ac42bec-f5cd-460d-a218-3001a68dbf8b" returned: 0 in 0.246s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-quobyte-7ac42bec-f5cd-460d-a218-3001a68dbf8b" released by "_delete_snapshot" :: held 1.730s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-quobyte-9d8c2d07-decf-4d8d-b7be-1916783e4b74" released by "delete_snapshot" :: held 1.757s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:16 devstack cinder-volume[87497]: WARNING cinder.quota [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:43:16 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Created reservations ['d5d80e1d-c345-43e8-822c-2747100a47c7', '8d5a32f0-3b51-43bd-86c9-bf333806e06a', '23fbb514-1ff8-4aa3-98b6-70a91e85099b', '75c0d790-05e0-4169-b57e-c2c1537964c9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:43:16 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Delete snapshot completed successfully. Jul 18 05:43:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-606e392c-6b1a-43b1-a664-5ac7ff1ff0db tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-7ac42bec-f5cd-460d-a218-3001a68dbf8b-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Acquiring lock "cinder-9d8c2d07-decf-4d8d-b7be-1916783e4b74-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-9d8c2d07-decf-4d8d-b7be-1916783e4b74-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Acquiring lock "cinder-quobyte-9d8c2d07-decf-4d8d-b7be-1916783e4b74" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-quobyte-9d8c2d07-decf-4d8d-b7be-1916783e4b74" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[58762840-6368-47b4-ac4a-019f3673e8a5]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:17 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 Jul 18 05:43:17 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:17 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74" returned: 0 in 0.429s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:17 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74 Jul 18 05:43:17 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:17 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d8c2d07-decf-4d8d-b7be-1916783e4b74" returned: 0 in 0.313s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-quobyte-9d8c2d07-decf-4d8d-b7be-1916783e4b74" released by "delete_volume" :: held 0.829s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Created reservations ['d44abee7-15da-436d-ba0a-0e04c0eff731', 'f612d778-8e18-4e73-91e1-ceaf02f82e64', '3f7480fc-19b3-40da-9dcb-f5900ce8c268', 'a935234d-1285-491f-acbc-0e31be414622'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:18 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:43:18 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:18 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.436s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:43:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Deleted volume successfully. Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05c24b5f-9c54-4a54-9d86-205b5aaebf64 tempest-VolumesSnapshotNegativeTestJSON-1508225016 None] Lock "cinder-9d8c2d07-decf-4d8d-b7be-1916783e4b74-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-109ed256-ab44-441c-96b8-a523e64f40c2 req-123e5e0a-e4f8-4a2e-b30d-0d01a1d5fbd1 tempest-AttachVolumeNegativeTest-1948277789 None] Terminate volume connection completed successfully. Jul 18 05:43:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-109ed256-ab44-441c-96b8-a523e64f40c2 req-123e5e0a-e4f8-4a2e-b30d-0d01a1d5fbd1 tempest-AttachVolumeNegativeTest-1948277789 None] Deleting attachment 0730c3b5-2b39-4a98-bddf-2d245a42ffb4. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Flow 'volume_create_manager' (4de65506-4ae0-4823-b22c-7c7ee6368c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7de0c8-1012-486b-8088-198fc39a8e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7de0c8-1012-486b-8088-198fc39a8e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-851485017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc85500-3edd-435a-b928-71311e818543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2070191afbe24273980e34e58126e636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:43:23Z,use_quota=True,user_id='2a1b78b75d2f4770adccdc3b315790f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b491db4-be04-47c9-b9bc-64567be967f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b491db4-be04-47c9-b9bc-64567be967f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2de8e9-8bea-44bc-b102-6273d3f4546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2de8e9-8bea-44bc-b102-6273d3f4546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc85500-3edd-435a-b928-71311e818543', 'volume_name': 'volume-dfc85500-3edd-435a-b928-71311e818543', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef95efd9-8ec3-457e-912a-5b392163eab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef95efd9-8ec3-457e-912a-5b392163eab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8bbc9c-621f-4a9d-8241-9842ed83fa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:23 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Volume dfc85500-3edd-435a-b928-71311e818543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc85500-3edd-435a-b928-71311e818543', 'volume_size': 1} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-851485017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc85500-3edd-435a-b928-71311e818543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2070191afbe24273980e34e58126e636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:43:23Z,use_quota=True,user_id='2a1b78b75d2f4770adccdc3b315790f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Creating volume dfc85500-3edd-435a-b928-71311e818543 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:43:23 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:23 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 1073741824 Jul 18 05:43:23 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:23 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 1073741824" returned: 0 in 0.483s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:23 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 Jul 18 05:43:23 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:24 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543" returned: 0 in 0.269s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8bbc9c-621f-4a9d-8241-9842ed83fa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc85500-3edd-435a-b928-71311e818543', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900a9398-2e08-415a-b00a-ae34851c5a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:24 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Volume volume-dfc85500-3edd-435a-b928-71311e818543 (dfc85500-3edd-435a-b928-71311e818543): created successfully Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900a9398-2e08-415a-b00a-ae34851c5a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Flow 'volume_create_manager' (4de65506-4ae0-4823-b22c-7c7ee6368c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:43:24 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-e1d27c0b-3644-4722-ac45-d3631f89a124 req-aa4ab675-4dc2-423b-8bd5-02dc6cdf91cb tempest-VolumesSnapshotsTestJSON-1316063232 None] Created volume successfully. Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Creating offline snapshot 4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f of volume dfc85500-3edd-435a-b928-71311e818543 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ce8fde-b906-4871-a5c2-f1979b0cafa2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:24 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-4dbfad10-0caa-4bad-8fba-e9ca7a82dc44 req-f60fec22-4cb0-4069-8946-78562eb01d43 tempest-AttachVolumeTestJSON-2089319826 None] Terminate volume connection completed successfully. Jul 18 05:43:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-4dbfad10-0caa-4bad-8fba-e9ca7a82dc44 req-f60fec22-4cb0-4069-8946-78562eb01d43 tempest-AttachVolumeTestJSON-2089319826 None] Deleting attachment 5d0185e4-5ba0-4df8-a292-75446ab9d687. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:43:24 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 Jul 18 05:43:24 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:25 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543" returned: 0 in 0.582s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:25 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f 1G Jul 18 05:43:25 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:25 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f 1G" returned: 0 in 0.631s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc85500-3edd-435a-b928-71311e818543 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:26 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc85500-3edd-435a-b928-71311e818543 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f Jul 18 05:43:26 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:26 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc85500-3edd-435a-b928-71311e818543 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f" returned: 0 in 0.365s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:26 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f is being set with open permissions: ugo+rw Jul 18 05:43:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:26 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f Jul 18 05:43:26 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:26 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f" returned: 0 in 0.264s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:26 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.info Jul 18 05:43:26 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:26 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.info" returned: 0 in 0.320s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:26 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.info is being set with open permissions: ugo+rw Jul 18 05:43:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:27 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.info Jul 18 05:43:27 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:27 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.info" returned: 0 in 0.288s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:27 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-94890385-2e71-4d6a-8022-31dd503bb483 req-04997650-2afb-45e0-a2ee-1f8b9267b509 tempest-VolumesSnapshotsTestJSON-1316063232 None] Create snapshot completed successfully Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Acquiring lock "cinder-4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Acquiring lock "cinder-quobyte-dfc85500-3edd-435a-b928-71311e818543" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-quobyte-dfc85500-3edd-435a-b928-71311e818543" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Acquiring lock "cinder-quobyte-4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-quobyte-4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Deleting offline snapshot 4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f of volume dfc85500-3edd-435a-b928-71311e818543 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] snapshot_file for this snap is: volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64b3e86-10d0-48a1-9d80-2aff22a1ee7b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:28 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f Jul 18 05:43:28 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:29 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f" returned: 0 in 0.410s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc85500-3edd-435a-b928-71311e818543(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:43:29 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[203d85c9-e9d7-4aa0-abcc-741047f86045]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:29 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 Jul 18 05:43:29 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:29 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543" returned: 0 in 0.497s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:29 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f Jul 18 05:43:29 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:30 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f" returned: 0 in 0.599s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:30 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f Jul 18 05:43:30 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:30 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543.4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f" returned: 0 in 0.487s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-quobyte-4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f" released by "_delete_snapshot" :: held 2.179s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-quobyte-dfc85500-3edd-435a-b928-71311e818543" released by "delete_snapshot" :: held 2.211s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:30 devstack cinder-volume[87497]: DEBUG cinder.quota [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Created reservations ['b236e245-3065-4cec-af7f-65afd1102d92', 'de8366b2-d414-47e2-a8bc-319b017697f9', '0db63037-4e5f-4f80-89cb-2879799332d8', '4f82e9b2-7f5b-45a3-9fa1-1b1cfc0f4a22'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:43:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Delete snapshot completed successfully. Jul 18 05:43:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cb3f131a-ba31-4eea-94e0-dc8e96c02f7d req-531f5f82-4d7f-4b4c-beef-839b75c9effb tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-4cdf6ae8-9bdb-4ed2-a5cd-7556b4e0129f-delete_snapshot" released by "delete_snapshot" :: held 2.541s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Acquiring lock "cinder-dfc85500-3edd-435a-b928-71311e818543-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-dfc85500-3edd-435a-b928-71311e818543-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Acquiring lock "cinder-quobyte-dfc85500-3edd-435a-b928-71311e818543" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-quobyte-dfc85500-3edd-435a-b928-71311e818543" acquired by "delete_volume" :: waited 0.057s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:32 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0876d44e-e93f-4d56-8fc8-fde0c12ec560]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:32 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 Jul 18 05:43:32 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:32 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543" returned: 0 in 0.598s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:32 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543 Jul 18 05:43:32 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:33 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfc85500-3edd-435a-b928-71311e818543" returned: 0 in 0.424s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-quobyte-dfc85500-3edd-435a-b928-71311e818543" released by "delete_volume" :: held 1.192s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG cinder.quota [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Created reservations ['bfd57643-666d-4402-bfc3-f4bef36f7848', 'f4f87835-4d45-45d6-b700-13372d4aa412', 'c0eea773-620f-48b8-86ff-420045f9e46b', '525d71bb-0a8b-4f19-869e-3a97a66c28b8'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:33 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:43:33 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:33 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.513s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:34 devstack cinder-volume[87497]: DEBUG cinder.manager [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:43:34 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Deleted volume successfully. Jul 18 05:43:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-a13fa259-cfba-445b-a206-4cafbb9b7830 req-f8a0c3df-1df8-4964-a180-afe9a3875e30 tempest-VolumesSnapshotsTestJSON-1316063232 None] Lock "cinder-dfc85500-3edd-435a-b928-71311e818543-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:43 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=47,cinder:INSERT=12,cinder:UPDATE=51,cinder:DELETE=4 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=42,cinder:UPDATE=54,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Flow 'volume_create_manager' (97c254b8-6a1d-4b0e-b280-f32546c24cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbde4551-b24b-4b5c-a68e-6927089b3832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbde4551-b24b-4b5c-a68e-6927089b3832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-641011401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe333e7f-2d8c-4d7d-a394-60f90355e8a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b667b64a1224330a5e7984700ba5055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:43:44Z,use_quota=True,user_id='2c8a1f087a8e44448dcc06950f316146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffff0269-4e5a-4564-8adc-be4b98bf6fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffff0269-4e5a-4564-8adc-be4b98bf6fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a73fc3d-29a3-430b-a15e-52de5f4b6377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a73fc3d-29a3-430b-a15e-52de5f4b6377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe333e7f-2d8c-4d7d-a394-60f90355e8a7', 'volume_name': 'volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a4c6e6-2b8e-4a5c-87e1-e1a50f94be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a4c6e6-2b8e-4a5c-87e1-e1a50f94be8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665b2e62-3469-4d23-842f-c0043b052b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:44 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Volume fe333e7f-2d8c-4d7d-a394-60f90355e8a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7', 'volume_size': 1} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-641011401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe333e7f-2d8c-4d7d-a394-60f90355e8a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b667b64a1224330a5e7984700ba5055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:43:44Z,use_quota=True,user_id='2c8a1f087a8e44448dcc06950f316146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Creating volume fe333e7f-2d8c-4d7d-a394-60f90355e8a7 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:43:44 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:43:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:44 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 1073741824 Jul 18 05:43:44 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:45 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 1073741824" returned: 0 in 0.842s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:45 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 Jul 18 05:43:45 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:45 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7" returned: 0 in 0.488s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:43:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665b2e62-3469-4d23-842f-c0043b052b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c174dd-9c25-4ad3-99ed-fbbecec0f2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:46 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Volume volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 (fe333e7f-2d8c-4d7d-a394-60f90355e8a7): created successfully Jul 18 05:43:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c174dd-9c25-4ad3-99ed-fbbecec0f2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Flow 'volume_create_manager' (97c254b8-6a1d-4b0e-b280-f32546c24cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:43:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-ca4b6421-dcda-49e0-b012-ce7ef05acf1a req-381f9da0-2b3d-4eed-ace4-68d4d0e5b352 tempest-VolumesGetTestJSON-1766928509 None] Created volume successfully. Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Acquiring lock "cinder-fe333e7f-2d8c-4d7d-a394-60f90355e8a7-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Lock "cinder-fe333e7f-2d8c-4d7d-a394-60f90355e8a7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Acquiring lock "cinder-quobyte-fe333e7f-2d8c-4d7d-a394-60f90355e8a7" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Lock "cinder-quobyte-fe333e7f-2d8c-4d7d-a394-60f90355e8a7" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7c1e11-0fe4-477b-9eaf-f0281a0947e6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:47 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 Jul 18 05:43:47 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:47 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7" returned: 0 in 0.436s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:47 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7 Jul 18 05:43:47 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:47 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fe333e7f-2d8c-4d7d-a394-60f90355e8a7" returned: 0 in 0.250s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Lock "cinder-quobyte-fe333e7f-2d8c-4d7d-a394-60f90355e8a7" released by "delete_volume" :: held 0.754s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:47 devstack cinder-volume[87497]: DEBUG cinder.quota [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Created reservations ['bc4b0be0-6f49-44b6-9f70-fa0ccd3b37ca', '6e1a62db-17b1-4eb5-b97a-50f5b7d74bfd', '87752e30-001b-4faa-bd80-6e09f1d61562', '251c1af7-fd0b-4734-a956-e9bdd6d6b1a4'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:43:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:48 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:43:48 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:48 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.266s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:48 devstack cinder-volume[87497]: DEBUG cinder.manager [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:43:48 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Deleted volume successfully. Jul 18 05:43:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-7c8799a9-b847-4ae6-b715-0cc0f0220356 req-830b28ae-56c1-47f2-9709-dfc475858810 tempest-VolumesGetTestJSON-1766928509 None] Lock "cinder-fe333e7f-2d8c-4d7d-a394-60f90355e8a7-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:43:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b404b691-1fab-4329-b2e9-904cdfbbf20b tempest-GroupSnapshotsTest-1276713363 None] Group tempest-GroupSnapshotsTest-Group-1373956137: creating Jul 18 05:43:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b404b691-1fab-4329-b2e9-904cdfbbf20b tempest-GroupSnapshotsTest-1276713363 None] Group tempest-GroupSnapshotsTest-Group-1373956137: created successfully Jul 18 05:43:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b404b691-1fab-4329-b2e9-904cdfbbf20b tempest-GroupSnapshotsTest-1276713363 None] Create group completed successfully. Jul 18 05:43:54 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Flow 'volume_create_manager' (c1cc6a02-4a64-41fb-9336-89da79b3acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48decd8e-d37e-4ec5-9a4a-e6483559f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48decd8e-d37e-4ec5-9a4a-e6483559f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524393213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23870f25-8a75-4fe0-b1f0-f640e15d9c29,host='devstack@QuobyteHD#QuobyteHD',id=3e6ba324-e144-461a-a7df-7a396e6783b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b035644e4dc4dbb91733fe907939d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:43:55Z,use_quota=True,user_id='d02b9816fa1a4cc4b03e21aed6a82179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba410025-abf0-4e9f-991b-ec7bda8c48a5),volume_type_id=ba410025-abf0-4e9f-991b-ec7bda8c48a5)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0a47a1-915e-4101-933c-708af7363110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0a47a1-915e-4101-933c-708af7363110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f31ff5-56bc-48f4-a493-cf20fc96e0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f31ff5-56bc-48f4-a493-cf20fc96e0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6ba324-e144-461a-a7df-7a396e6783b6', 'volume_name': 'volume-3e6ba324-e144-461a-a7df-7a396e6783b6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f285485e-545f-4c3f-9a8c-edd6f839f224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f285485e-545f-4c3f-9a8c-edd6f839f224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edd1a75-8cc6-4e12-ab21-b51475160340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:55 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Volume 3e6ba324-e144-461a-a7df-7a396e6783b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6ba324-e144-461a-a7df-7a396e6783b6', 'volume_size': 1} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23870f25-8a75-4fe0-b1f0-f640e15d9c29,created_at=2026-07-18T03:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524393213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23870f25-8a75-4fe0-b1f0-f640e15d9c29,host='devstack@QuobyteHD#QuobyteHD',id=3e6ba324-e144-461a-a7df-7a396e6783b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b035644e4dc4dbb91733fe907939d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:43:55Z,use_quota=True,user_id='d02b9816fa1a4cc4b03e21aed6a82179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba410025-abf0-4e9f-991b-ec7bda8c48a5),volume_type_id=ba410025-abf0-4e9f-991b-ec7bda8c48a5)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Creating volume 3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:43:55 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:55 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 1073741824 Jul 18 05:43:55 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:55 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 1073741824" returned: 0 in 0.552s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:55 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 Jul 18 05:43:55 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:56 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6" returned: 0 in 0.285s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:43:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:43:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edd1a75-8cc6-4e12-ab21-b51475160340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6ba324-e144-461a-a7df-7a396e6783b6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09786ef-c00d-444d-ab3c-21a3bfcf1475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:43:56 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Volume volume-3e6ba324-e144-461a-a7df-7a396e6783b6 (3e6ba324-e144-461a-a7df-7a396e6783b6): created successfully Jul 18 05:43:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09786ef-c00d-444d-ab3c-21a3bfcf1475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:43:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Flow 'volume_create_manager' (c1cc6a02-4a64-41fb-9336-89da79b3acb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:43:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-27ba9ad4-3c23-484a-8ac5-6897df48491c tempest-GroupSnapshotsTest-1276713363 None] Created volume successfully. Jul 18 05:43:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] GroupSnapshot 779263a4-3af3-4dd0-adec-ee76723089fd: creating. Jul 18 05:43:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Group snapshot 779263a4-3af3-4dd0-adec-ee76723089fd: creating. {{(pid=87497) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 18 05:43:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:43:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:43:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Creating offline snapshot f9e16dd0-8dd2-4030-b911-b3ce16caaeec of volume 3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:43:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f73f8c-03dd-4573-9689-f56bfb2bb576]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:43:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:57 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 Jul 18 05:43:57 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:58 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6" returned: 0 in 0.397s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:58 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec 1G Jul 18 05:43:58 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:58 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec 1G" returned: 0 in 0.550s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e6ba324-e144-461a-a7df-7a396e6783b6 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:58 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e6ba324-e144-461a-a7df-7a396e6783b6 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec Jul 18 05:43:58 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:59 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e6ba324-e144-461a-a7df-7a396e6783b6 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec" returned: 0 in 0.330s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:59 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:43:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:59 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec Jul 18 05:43:59 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:59 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec" returned: 0 in 0.283s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:59 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.info Jul 18 05:43:59 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:43:59 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 18 05:43:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.info" returned: 0 in 0.313s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:43:59 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:43:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:43:59 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.info Jul 18 05:43:59 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:00 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.info" returned: 0 in 0.313s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.310s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:00 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-edb2c815-fa79-4648-94b1-b843c2b562c8 tempest-GroupSnapshotsTest-1276713363 None] group_snapshot 779263a4-3af3-4dd0-adec-ee76723089fd: created successfully Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-f9e16dd0-8dd2-4030-b911-b3ce16caaeec-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" by "_create_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-f9e16dd0-8dd2-4030-b911-b3ce16caaeec-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Creating volume b4cd1404-29d9-4a93-bae3-fc6572e0ff70 from snapshot f9e16dd0-8dd2-4030-b911-b3ce16caaeec {{(pid=87497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] snapshot: f9e16dd0-8dd2-4030-b911-b3ce16caaeec, volume: b4cd1404-29d9-4a93-bae3-fc6572e0ff70, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8332ad4d-1a82-4837-ba41-20c3f41bc88e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:02 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec Jul 18 05:44:02 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:02 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec" returned: 0 in 0.645s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e6ba324-e144-461a-a7df-7a396e6783b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7138e402-c12b-44d7-a618-d7d771640404]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:03 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 Jul 18 05:44:03 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:03 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6" returned: 0 in 0.405s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:03 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:44:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:03 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 Jul 18 05:44:03 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:44:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:06 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:44:06 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:07 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 1.141s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Flow 'volume_create_manager' (c94f9be7-7692-4131-906b-7f8aefbff060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf80adb5-0caf-4e50-a365-9997dbc8422f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 8 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf80adb5-0caf-4e50-a365-9997dbc8422f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-655203128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb62f9d7-52ef-445d-b7b9-c9d5468f3053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21b8b48e074f20bd893b0f43484099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:07Z,use_quota=True,user_id='d37ba7036b574354845e90ec62f0b024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef486f4-f2c9-433e-8e36-863310867bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef486f4-f2c9-433e-8e36-863310867bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2383596-9826-42a2-8021-acd9c5c443eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2383596-9826-42a2-8021-acd9c5c443eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb62f9d7-52ef-445d-b7b9-c9d5468f3053', 'volume_name': 'volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10a8aba-5357-4ab5-946e-bda65ba33165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10a8aba-5357-4ab5-946e-bda65ba33165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590c95da-7d76-496e-99d1-cd4bce780b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:07 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Volume fb62f9d7-52ef-445d-b7b9-c9d5468f3053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053', 'volume_size': 1} Jul 18 05:44:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:12 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" returned: 0 in 9.479s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:12 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1638872d-c24f-431a-9a12-5463048a7e04]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:13 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 Jul 18 05:44:13 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:13 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6" returned: 0 in 0.791s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:13 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6, size 1024.00 MB, duration 9.48 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:44:13 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Converted 1024.00 MB image at 108.01 MB/s Jul 18 05:44:13 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:44:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:13 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 Jul 18 05:44:13 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:14 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" returned: 0 in 0.363s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" released by "_copy_volume_from_snapshot" :: held 11.892s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-f9e16dd0-8dd2-4030-b911-b3ce16caaeec-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" released by "_create_volume_from_snapshot" :: held 11.946s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.971s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.535s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-655203128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb62f9d7-52ef-445d-b7b9-c9d5468f3053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21b8b48e074f20bd893b0f43484099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:07Z,use_quota=True,user_id='d37ba7036b574354845e90ec62f0b024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Creating volume fb62f9d7-52ef-445d-b7b9-c9d5468f3053 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:44:14 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:14 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 1073741824 Jul 18 05:44:14 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ecd39876-931a-47de-a5f1-a2db1ead1cc0 tempest-GroupSnapshotsTest-1276713363 None] Create group from source-snapshot-779263a4-3af3-4dd0-adec-ee76723089fd completed successfully. Jul 18 05:44:14 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 1073741824" returned: 0 in 0.664s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:14 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 Jul 18 05:44:14 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:15 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053" returned: 0 in 0.379s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:44:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590c95da-7d76-496e-99d1-cd4bce780b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78fe84f-a824-4aa3-b407-a618900914a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Volume volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 (fb62f9d7-52ef-445d-b7b9-c9d5468f3053): created successfully Jul 18 05:44:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78fe84f-a824-4aa3-b407-a618900914a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Flow 'volume_create_manager' (c94f9be7-7692-4131-906b-7f8aefbff060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:15 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c710c8f3-a6ca-411e-b098-19bb36eacfcd tempest-AttachVolumeNegativeTest-1948277789 None] Created volume successfully. Jul 18 05:44:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" acquired by "delete_volume" :: waited 0.090s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7543eb2f-fc33-4acf-b723-34bda17b8b33]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:17 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 Jul 18 05:44:17 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:18 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" returned: 0 in 0.942s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:18 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70 Jul 18 05:44:18 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-5f4640a3-6125-4252-ae6c-fd031e00c4bb req-6afbbc5d-4d16-494f-962b-a0d77f2d4a49 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-5f4640a3-6125-4252-ae6c-fd031e00c4bb req-6afbbc5d-4d16-494f-962b-a0d77f2d4a49 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-5f4640a3-6125-4252-ae6c-fd031e00c4bb req-6afbbc5d-4d16-494f-962b-a0d77f2d4a49 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-5f4640a3-6125-4252-ae6c-fd031e00c4bb req-6afbbc5d-4d16-494f-962b-a0d77f2d4a49 tempest-AttachVolumeNegativeTest-1948277789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6c172a9-e9f9-40a1-be96-0a1df8bd114f', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:44:19 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" returned: 0 in 0.450s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-b4cd1404-29d9-4a93-bae3-fc6572e0ff70" released by "delete_volume" :: held 1.527s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-5f4640a3-6125-4252-ae6c-fd031e00c4bb req-6afbbc5d-4d16-494f-962b-a0d77f2d4a49 tempest-AttachVolumeNegativeTest-1948277789 None] attachment_update completed successfully. Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['aaaed9b5-6fd9-42d7-a718-fde05821fb32'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:19 devstack cinder-volume[87497]: WARNING cinder.quota [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1137374686 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1137374686, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:44:19 devstack cinder-volume[87497]: WARNING cinder.quota [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1137374686 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1137374686, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['b6b4698b-1a9b-49fa-8537-5b9af80ceb6d', '3ecb97af-42b3-4e54-9ad4-ae3a8f52710d', 'b853e2e6-be26-4f93-b615-f5dd8b6f2b45', 'faf901e3-ea5f-44a6-9d3b-520a4c2c2830'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:19 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:44:19 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:19 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.407s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:19 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:44:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-879cb905-0b7a-4274-83fb-f0f087989c10 tempest-GroupSnapshotsTest-1276713363 None] Delete group completed successfully. Jul 18 05:44:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] group_snapshot 779263a4-3af3-4dd0-adec-ee76723089fd: deleting Jul 18 05:44:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] group_snapshot 779263a4-3af3-4dd0-adec-ee76723089fd: deleting {{(pid=87497) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 18 05:44:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-3e6ba324-e144-461a-a7df-7a396e6783b6" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-3e6ba324-e144-461a-a7df-7a396e6783b6" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-f9e16dd0-8dd2-4030-b911-b3ce16caaeec" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-f9e16dd0-8dd2-4030-b911-b3ce16caaeec" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Deleting offline snapshot f9e16dd0-8dd2-4030-b911-b3ce16caaeec of volume 3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:44:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] snapshot_file for this snap is: volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:44:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5b4cf3-9625-4824-9f9d-cafc828921f1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:20 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec Jul 18 05:44:20 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:21 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec" returned: 0 in 0.505s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e6ba324-e144-461a-a7df-7a396e6783b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:44:21 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[285c4af7-6237-4813-9061-8c7f13ce94cf]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:21 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 Jul 18 05:44:21 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:21 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6" returned: 0 in 0.536s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:21 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec Jul 18 05:44:21 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:22 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec" returned: 0 in 0.478s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-f43e2937-2180-4e36-a500-778c0ab3cb47 req-84b3af5e-9085-4753-8757-6f34fd150f85 tempest-AttachVolumeNegativeTest-1948277789 None] Terminate volume connection completed successfully. Jul 18 05:44:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-f43e2937-2180-4e36-a500-778c0ab3cb47 req-84b3af5e-9085-4753-8757-6f34fd150f85 tempest-AttachVolumeNegativeTest-1948277789 None] Deleting attachment e6c172a9-e9f9-40a1-be96-0a1df8bd114f. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:44:22 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec Jul 18 05:44:22 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:22 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6.f9e16dd0-8dd2-4030-b911-b3ce16caaeec" returned: 0 in 0.352s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-f9e16dd0-8dd2-4030-b911-b3ce16caaeec" released by "_delete_snapshot" :: held 2.034s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-3e6ba324-e144-461a-a7df-7a396e6783b6" released by "delete_snapshot" :: held 2.075s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:22 devstack cinder-volume[87497]: WARNING cinder.quota [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1137374686 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1137374686, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:44:22 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['0e521ce8-5c41-4c35-b4b6-5704530466e1', 'c11eb02c-1cd8-405c-99d7-ac925df89506', '62678706-c866-4067-8003-48f248bc38b0', '7c0b81ae-70de-4549-8c47-e6ef5332278b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d72122e2-8086-4bc6-b70d-85a64796af5a tempest-GroupSnapshotsTest-1276713363 None] group_snapshot 779263a4-3af3-4dd0-adec-ee76723089fd: deleted successfully Jul 18 05:44:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-3e6ba324-e144-461a-a7df-7a396e6783b6" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-3e6ba324-e144-461a-a7df-7a396e6783b6" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:23 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba3a7da-173e-4763-8893-7e74f1d113f6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:23 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 Jul 18 05:44:23 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:23 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6" returned: 0 in 0.676s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:24 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6 Jul 18 05:44:24 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:24 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3e6ba324-e144-461a-a7df-7a396e6783b6" returned: 0 in 0.459s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-3e6ba324-e144-461a-a7df-7a396e6783b6" released by "delete_volume" :: held 1.271s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['ee5ad8cc-e801-43b1-8e28-01b1602605d0'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:24 devstack cinder-volume[87497]: WARNING cinder.db.api [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1137374686'] Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['848b3954-b619-4873-8e5c-d7934212a1ae', 'df9fe61e-e503-40bf-b811-7aefee4d8cfc', 'b8829e27-52ed-46d4-83ed-f159bfb2b2e3', '61a8756f-5372-4c7a-858e-ff4145779b7d'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:24 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:44:24 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:25 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.336s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:25 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:44:25 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e06d5235-4ce2-46e8-be58-adfbb1c6a38c tempest-GroupSnapshotsTest-1276713363 None] Delete group completed successfully. Jul 18 05:44:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7da05ef3-32cf-4a73-86fe-2cf605676735 tempest-GroupSnapshotsTest-1276713363 None] Group tempest-GroupSnapshotsTest-Group-2015786254: creating Jul 18 05:44:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7da05ef3-32cf-4a73-86fe-2cf605676735 tempest-GroupSnapshotsTest-1276713363 None] Group tempest-GroupSnapshotsTest-Group-2015786254: created successfully Jul 18 05:44:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7da05ef3-32cf-4a73-86fe-2cf605676735 tempest-GroupSnapshotsTest-1276713363 None] Create group completed successfully. Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Flow 'volume_create_manager' (b93d51b2-5193-46ed-92c4-0627aaa6e7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fd79a3-ebc7-4651-8178-5511adbcfb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fd79a3-ebc7-4651-8178-5511adbcfb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-638818882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecc2b560-7ba3-4fca-a8d7-e0732a2c3938,host='devstack@QuobyteHD#QuobyteHD',id=f0bdfd9d-cca8-4089-83e3-ae95de82ab39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b035644e4dc4dbb91733fe907939d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:28Z,use_quota=True,user_id='d02b9816fa1a4cc4b03e21aed6a82179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(005a2dd4-aa9f-4fa6-b023-6c7da7358ee3),volume_type_id=005a2dd4-aa9f-4fa6-b023-6c7da7358ee3)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115e13ce-2a4a-4ecd-8d05-efc427f2e96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115e13ce-2a4a-4ecd-8d05-efc427f2e96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2b04f1-30f5-4773-a213-e562b0201de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2b04f1-30f5-4773-a213-e562b0201de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0bdfd9d-cca8-4089-83e3-ae95de82ab39', 'volume_name': 'volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138ae0c8-baef-49ca-94e3-b9d4d91b92d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138ae0c8-baef-49ca-94e3-b9d4d91b92d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41b3884-8d43-4401-80cf-03973ca9869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:28 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Volume f0bdfd9d-cca8-4089-83e3-ae95de82ab39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39', 'volume_size': 1} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ecc2b560-7ba3-4fca-a8d7-e0732a2c3938,created_at=2026-07-18T03:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-638818882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecc2b560-7ba3-4fca-a8d7-e0732a2c3938,host='devstack@QuobyteHD#QuobyteHD',id=f0bdfd9d-cca8-4089-83e3-ae95de82ab39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b035644e4dc4dbb91733fe907939d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:28Z,use_quota=True,user_id='d02b9816fa1a4cc4b03e21aed6a82179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(005a2dd4-aa9f-4fa6-b023-6c7da7358ee3),volume_type_id=005a2dd4-aa9f-4fa6-b023-6c7da7358ee3)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Creating volume f0bdfd9d-cca8-4089-83e3-ae95de82ab39 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:44:28 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:28 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 1073741824 Jul 18 05:44:28 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:28 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 1073741824" returned: 0 in 0.581s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:28 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 Jul 18 05:44:28 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:29 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" returned: 0 in 0.360s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:44:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41b3884-8d43-4401-80cf-03973ca9869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a88c2f-b875-4100-b1df-7d0d42b5f73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:29 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Volume volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 (f0bdfd9d-cca8-4089-83e3-ae95de82ab39): created successfully Jul 18 05:44:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a88c2f-b875-4100-b1df-7d0d42b5f73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Flow 'volume_create_manager' (b93d51b2-5193-46ed-92c4-0627aaa6e7b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:29 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-cfbe07b5-c98b-4e62-8431-25ce031e1451 tempest-GroupSnapshotsTest-1276713363 None] Created volume successfully. Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Flow 'volume_create_manager' (cf6c5a3e-0b61-4a64-90bb-3c209ded3426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37617870-6016-4ffe-8834-fcdb806698ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37617870-6016-4ffe-8834-fcdb806698ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1199468932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecc2b560-7ba3-4fca-a8d7-e0732a2c3938,host='devstack@QuobyteHD#QuobyteHD',id=8c3eadd7-94af-47ad-82d1-aadb8bc34d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b035644e4dc4dbb91733fe907939d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:30Z,use_quota=True,user_id='d02b9816fa1a4cc4b03e21aed6a82179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(005a2dd4-aa9f-4fa6-b023-6c7da7358ee3),volume_type_id=005a2dd4-aa9f-4fa6-b023-6c7da7358ee3)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a33499-b689-437e-ac3e-39c8edceee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a33499-b689-437e-ac3e-39c8edceee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227796f6-3de0-4d09-92ce-60d7bba1508f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227796f6-3de0-4d09-92ce-60d7bba1508f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c3eadd7-94af-47ad-82d1-aadb8bc34d5d', 'volume_name': 'volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf74f7f0-6fdf-453c-85c8-af0c52af69e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf74f7f0-6fdf-453c-85c8-af0c52af69e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136823ed-086c-4b15-ac1e-bb0d8c7eb30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:30 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Volume 8c3eadd7-94af-47ad-82d1-aadb8bc34d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d', 'volume_size': 1} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ecc2b560-7ba3-4fca-a8d7-e0732a2c3938,created_at=2026-07-18T03:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1199468932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecc2b560-7ba3-4fca-a8d7-e0732a2c3938,host='devstack@QuobyteHD#QuobyteHD',id=8c3eadd7-94af-47ad-82d1-aadb8bc34d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b035644e4dc4dbb91733fe907939d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:30Z,use_quota=True,user_id='d02b9816fa1a4cc4b03e21aed6a82179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(005a2dd4-aa9f-4fa6-b023-6c7da7358ee3),volume_type_id=005a2dd4-aa9f-4fa6-b023-6c7da7358ee3)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Creating volume 8c3eadd7-94af-47ad-82d1-aadb8bc34d5d {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:44:30 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:30 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d 1073741824 Jul 18 05:44:30 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:30 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d 1073741824" returned: 0 in 0.487s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:30 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d Jul 18 05:44:30 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:31 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" returned: 0 in 0.274s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:44:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136823ed-086c-4b15-ac1e-bb0d8c7eb30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7972e65b-1656-4809-b1ec-ef8e2ddeb18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Volume volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d (8c3eadd7-94af-47ad-82d1-aadb8bc34d5d): created successfully Jul 18 05:44:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7972e65b-1656-4809-b1ec-ef8e2ddeb18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Flow 'volume_create_manager' (cf6c5a3e-0b61-4a64-90bb-3c209ded3426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-542f5a92-79e6-4b15-b92b-02a54dc61afd tempest-GroupSnapshotsTest-1276713363 None] Created volume successfully. Jul 18 05:44:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a168767c-58f0-40fe-90cf-b5910148adbf tempest-GroupSnapshotsTest-1276713363 None] Update group completed successfully. Jul 18 05:44:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d74c7dc6-dc9f-4096-a260-621be2ddf21d tempest-GroupSnapshotsTest-1276713363 None] Update group completed successfully. Jul 18 05:44:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-29b18084-e2b1-4822-b73f-3a461850fb0f tempest-GroupSnapshotsTest-1276713363 None] Update group completed successfully. Jul 18 05:44:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c5170676-e002-4b6f-ba99-fbc1f2f8ae58 tempest-GroupSnapshotsTest-1276713363 None] Update group completed successfully. Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Flow 'volume_create_manager' (e445bd5c-1d9e-4760-89a2-48d2ac38cb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e710fc7-7340-42f1-80ec-035e5da9674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e710fc7-7340-42f1-80ec-035e5da9674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-455801274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379b95cc-3bc1-48c6-b6d0-71210e047469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55672e1f55034fec9e7b7ebe14866320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:35Z,use_quota=True,user_id='c66136f8504445b5b014e14e11d2d7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8eaf40-13c2-4109-8ac9-01b43311a3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8eaf40-13c2-4109-8ac9-01b43311a3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9e41ef-a837-41de-b2d1-ebe8098afcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9e41ef-a837-41de-b2d1-ebe8098afcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379b95cc-3bc1-48c6-b6d0-71210e047469', 'volume_name': 'volume-379b95cc-3bc1-48c6-b6d0-71210e047469', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2baf6ad7-a5b3-428a-8b65-80a3fb810577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2baf6ad7-a5b3-428a-8b65-80a3fb810577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed2188e-0bf4-423f-9d5c-ef1f5cb2c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:35 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Volume 379b95cc-3bc1-48c6-b6d0-71210e047469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379b95cc-3bc1-48c6-b6d0-71210e047469', 'volume_size': 1} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-455801274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379b95cc-3bc1-48c6-b6d0-71210e047469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55672e1f55034fec9e7b7ebe14866320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:35Z,use_quota=True,user_id='c66136f8504445b5b014e14e11d2d7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Creating volume 379b95cc-3bc1-48c6-b6d0-71210e047469 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:44:35 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:44:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:35 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469 1073741824 Jul 18 05:44:35 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:36 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469 1073741824" returned: 0 in 0.567s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:36 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469 Jul 18 05:44:36 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:36 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469" returned: 0 in 0.507s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:44:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed2188e-0bf4-423f-9d5c-ef1f5cb2c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379b95cc-3bc1-48c6-b6d0-71210e047469', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2651be52-f5a0-4a20-8316-f9e4c79af8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:36 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Volume volume-379b95cc-3bc1-48c6-b6d0-71210e047469 (379b95cc-3bc1-48c6-b6d0-71210e047469): created successfully Jul 18 05:44:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2651be52-f5a0-4a20-8316-f9e4c79af8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Flow 'volume_create_manager' (e445bd5c-1d9e-4760-89a2-48d2ac38cb53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:36 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-fcea9d96-5226-40bc-bb63-b837fe35667c tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Created volume successfully. Jul 18 05:44:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] GroupSnapshot 6bb96615-e2c7-488f-83c4-667ac78c994b: creating. Jul 18 05:44:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Group snapshot 6bb96615-e2c7-488f-83c4-667ac78c994b: creating. {{(pid=87497) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 18 05:44:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Creating offline snapshot 8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 of volume f0bdfd9d-cca8-4089-83e3-ae95de82ab39 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:44:37 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fa502e-784a-4b65-840c-9dc866e844cb]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:37 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 Jul 18 05:44:37 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:37 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" returned: 0 in 0.511s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:37 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 1G Jul 18 05:44:37 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:38 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 1G" returned: 0 in 0.560s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:38 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 Jul 18 05:44:38 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-5d853f93-f6f7-4d53-98af-66bd35b9d8dc req-dd5cd5c1-544c-461b-a3f2-d7f1e842f17a tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:38 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6" returned: 0 in 0.434s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:38 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:44:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:38 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 Jul 18 05:44:38 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:39 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6" returned: 0 in 0.299s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:39 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.info Jul 18 05:44:39 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:39 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.info" returned: 0 in 0.380s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:39 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:44:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:39 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.info Jul 18 05:44:39 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:39 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.info" returned: 0 in 0.430s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Creating offline snapshot a7706596-ffd4-4f79-9b61-4b4d88f1799f of volume 8c3eadd7-94af-47ad-82d1-aadb8bc34d5d {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:44:40 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabc2b99-324c-49a6-988f-56456b0fe7bc]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:40 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d Jul 18 05:44:40 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:40 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" returned: 0 in 0.506s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:40 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f 1G Jul 18 05:44:40 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:41 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f 1G" returned: 0 in 0.501s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:41 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f Jul 18 05:44:41 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:41 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f" returned: 0 in 0.317s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:41 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:44:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:41 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f Jul 18 05:44:41 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:41 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f" returned: 0 in 0.315s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:41 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.info Jul 18 05:44:41 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:41 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.info" returned: 0 in 0.276s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:41 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:44:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:42 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.info Jul 18 05:44:42 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Flow 'volume_create_manager' (c19db9aa-be4f-46cb-9443-5f1dd1d742e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8d4832-c51d-4eca-985d-f0dcd7f24015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8d4832-c51d-4eca-985d-f0dcd7f24015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-384247598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531d96e7-ce29-4ec3-929e-76d9c2ccc6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de092f296db2409e87fa257dd20c66e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:42Z,use_quota=True,user_id='ca64b221b701499a8068050d68b72b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888ba665-fc7d-4df9-9e5d-0f5736a780be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888ba665-fc7d-4df9-9e5d-0f5736a780be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f908d92a-312e-4540-ac42-045960be0869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f908d92a-312e-4540-ac42-045960be0869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531d96e7-ce29-4ec3-929e-76d9c2ccc6d5', 'volume_name': 'volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb0acc7-d690-4c8f-a20f-b3966632e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb0acc7-d690-4c8f-a20f-b3966632e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088f57cd-806c-4295-a3bf-eda7d3294831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:42 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Volume 531d96e7-ce29-4ec3-929e-76d9c2ccc6d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5', 'volume_size': 1} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:42 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.info" returned: 0 in 0.265s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-5d853f93-f6f7-4d53-98af-66bd35b9d8dc req-dd5cd5c1-544c-461b-a3f2-d7f1e842f17a tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.757s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-5d853f93-f6f7-4d53-98af-66bd35b9d8dc req-dd5cd5c1-544c-461b-a3f2-d7f1e842f17a tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-384247598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531d96e7-ce29-4ec3-929e-76d9c2ccc6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de092f296db2409e87fa257dd20c66e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:42Z,use_quota=True,user_id='ca64b221b701499a8068050d68b72b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Creating volume 531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:44:42 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:42 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 1073741824 Jul 18 05:44:42 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-5d853f93-f6f7-4d53-98af-66bd35b9d8dc req-dd5cd5c1-544c-461b-a3f2-d7f1e842f17a tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-379b95cc-3bc1-48c6-b6d0-71210e047469', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c94336c-2c31-4bdc-85ce-35d64f3e33cf', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:44:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-5d853f93-f6f7-4d53-98af-66bd35b9d8dc req-dd5cd5c1-544c-461b-a3f2-d7f1e842f17a tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] attachment_update completed successfully. Jul 18 05:44:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-29a4adda-5160-42c3-a5cf-c325446b623d tempest-GroupSnapshotsTest-1276713363 None] group_snapshot 6bb96615-e2c7-488f-83c4-667ac78c994b: created successfully Jul 18 05:44:42 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 1073741824" returned: 0 in 0.540s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:42 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 Jul 18 05:44:42 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] group_snapshot 6bb96615-e2c7-488f-83c4-667ac78c994b: deleting Jul 18 05:44:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] group_snapshot 6bb96615-e2c7-488f-83c4-667ac78c994b: deleting {{(pid=87497) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-8ba30a0f-3c98-44e5-9e50-20da8edcbeb6" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-8ba30a0f-3c98-44e5-9e50-20da8edcbeb6" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Deleting offline snapshot 8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 of volume f0bdfd9d-cca8-4089-83e3-ae95de82ab39 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] snapshot_file for this snap is: volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6fcd5a-c0f3-4b17-9fab-56b896259b79]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:43 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5" returned: 0 in 0.542s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:44:43 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:43 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088f57cd-806c-4295-a3bf-eda7d3294831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6815284-f229-4614-8373-d63e96b6b518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:43 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Volume volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 (531d96e7-ce29-4ec3-929e-76d9c2ccc6d5): created successfully Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6815284-f229-4614-8373-d63e96b6b518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Flow 'volume_create_manager' (c19db9aa-be4f-46cb-9443-5f1dd1d742e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a94e63ff-39ba-4a23-9482-3345718dc685 tempest-AttachVolumeTestJSON-2089319826 None] Created volume successfully. Jul 18 05:44:43 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6" returned: 0 in 0.558s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f62b44-3c16-4a1f-b729-f44d4601bf6c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:43 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 Jul 18 05:44:43 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:44 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" returned: 0 in 0.396s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:44 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 Jul 18 05:44:44 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:44 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6" returned: 0 in 0.446s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:44 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6 Jul 18 05:44:44 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:45 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39.8ba30a0f-3c98-44e5-9e50-20da8edcbeb6" returned: 0 in 0.476s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-8ba30a0f-3c98-44e5-9e50-20da8edcbeb6" released by "_delete_snapshot" :: held 2.034s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" released by "delete_snapshot" :: held 2.105s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=74,cinder:SELECT=90,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-a7706596-ffd4-4f79-9b61-4b4d88f1799f" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-a7706596-ffd4-4f79-9b61-4b4d88f1799f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Deleting offline snapshot a7706596-ffd4-4f79-9b61-4b4d88f1799f of volume 8c3eadd7-94af-47ad-82d1-aadb8bc34d5d {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] snapshot_file for this snap is: volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e119adeb-ed53-4ff3-aa55-0f9ed2e7108f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:45 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f Jul 18 05:44:45 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=88,cinder:UPDATE=70,cinder:DELETE=3,cinder:INSERT=14 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:44:45 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-29b46396-8e77-40ea-be7e-a7ebc6f76471 req-b76c2da0-f65c-4ba9-81f2-f5f695195d78 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Terminate volume connection completed successfully. Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-29b46396-8e77-40ea-be7e-a7ebc6f76471 req-b76c2da0-f65c-4ba9-81f2-f5f695195d78 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Deleting attachment 8c94336c-2c31-4bdc-85ce-35d64f3e33cf. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-8e365c42-6957-4823-899c-31b2d2a1d4a1 req-dededbac-6fa9-4f6d-b09a-f8a030fa6aa0 tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-8e365c42-6957-4823-899c-31b2d2a1d4a1 req-dededbac-6fa9-4f6d-b09a-f8a030fa6aa0 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-8e365c42-6957-4823-899c-31b2d2a1d4a1 req-dededbac-6fa9-4f6d-b09a-f8a030fa6aa0 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-8e365c42-6957-4823-899c-31b2d2a1d4a1 req-dededbac-6fa9-4f6d-b09a-f8a030fa6aa0 tempest-AttachVolumeTestJSON-2089319826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b864de3e-1261-4d3f-8fa2-17b1cdb5b487', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:44:45 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f" returned: 0 in 0.540s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18c35d5-534d-4145-94c4-e410862aeef6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:45 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-8e365c42-6957-4823-899c-31b2d2a1d4a1 req-dededbac-6fa9-4f6d-b09a-f8a030fa6aa0 tempest-AttachVolumeTestJSON-2089319826 None] attachment_update completed successfully. Jul 18 05:44:46 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d Jul 18 05:44:46 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:46 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" returned: 0 in 0.493s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:46 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f Jul 18 05:44:46 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Acquiring lock "cinder-379b95cc-3bc1-48c6-b6d0-71210e047469-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "cinder-379b95cc-3bc1-48c6-b6d0-71210e047469-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Acquiring lock "cinder-quobyte-379b95cc-3bc1-48c6-b6d0-71210e047469" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "cinder-quobyte-379b95cc-3bc1-48c6-b6d0-71210e047469" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ebaab6-6f8d-4f4e-b7db-6cc4df23d694]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:46 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469 Jul 18 05:44:46 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:46 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f" returned: 0 in 0.576s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:47 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f Jul 18 05:44:47 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:47 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469" returned: 0 in 0.501s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:47 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469 Jul 18 05:44:47 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:47 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d.a7706596-ffd4-4f79-9b61-4b4d88f1799f" returned: 0 in 0.328s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-a7706596-ffd4-4f79-9b61-4b4d88f1799f" released by "_delete_snapshot" :: held 2.095s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" released by "delete_snapshot" :: held 2.128s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:47 devstack cinder-volume[87497]: WARNING cinder.quota [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1761120418 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1761120418, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:44:47 devstack cinder-volume[87497]: WARNING cinder.quota [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1761120418 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1761120418, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['f44a9ddb-4e0e-44b1-8e90-c6db7f4d6dfe', 'f4c2ada8-595e-4061-95ab-e17a8eae678b', '24feb56e-1170-4305-bba2-71bf7133ffa9', '22106fdf-a7d7-4bd8-9d73-1d9f1ef2795d'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:47 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-379b95cc-3bc1-48c6-b6d0-71210e047469" returned: 0 in 0.288s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "cinder-quobyte-379b95cc-3bc1-48c6-b6d0-71210e047469" released by "delete_volume" :: held 0.840s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Created reservations ['0f01b110-422c-48b0-a750-f938f48f2974', 'a5382820-4bff-4e53-a3de-35f7a55dbcea', '6bb8d268-f3d9-48bc-90ce-907d922a428f', '7039ec0f-6b2d-42c3-ad5d-c48c92875885'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['18520ed0-c8e5-478b-bf27-2029511e8742', '99819446-4790-4b64-9b67-4586a70566bc', 'f8aa5a9d-31fb-460c-8fad-03d781a36eb2', 'edf5065c-4a89-4d6e-9b64-5abc5c0eed12'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:47 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:44:47 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d907d5a5-b843-4cb3-88a9-b37b1da0f752 tempest-GroupSnapshotsTest-1276713363 None] group_snapshot 6bb96615-e2c7-488f-83c4-667ac78c994b: deleted successfully Jul 18 05:44:48 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.476s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:44:48 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Deleted volume successfully. Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e8ebd2fa-0e48-4353-bd50-ab9ec7ffff40 tempest-TestServerVolumeAttachScenarioOldVersion-866644715 None] Lock "cinder-379b95cc-3bc1-48c6-b6d0-71210e047469-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Flow 'volume_create_manager' (15daf958-e92d-4bae-b0eb-d6cd73833c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b95761-bdf7-4bdd-b74d-941fb9be0bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b95761-bdf7-4bdd-b74d-941fb9be0bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1582363560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38de157-37c6-4aa1-86f5-d3f124225b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de092f296db2409e87fa257dd20c66e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:49Z,use_quota=True,user_id='ca64b221b701499a8068050d68b72b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f0c4d2-7e61-4fa4-9546-d320be3abc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f0c4d2-7e61-4fa4-9546-d320be3abc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa1707e-7939-470d-b819-8254a6020d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa1707e-7939-470d-b819-8254a6020d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38de157-37c6-4aa1-86f5-d3f124225b56', 'volume_name': 'volume-f38de157-37c6-4aa1-86f5-d3f124225b56', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c713f8-d13f-4aef-87ee-d077778b3cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c713f8-d13f-4aef-87ee-d077778b3cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7505b0af-bcbc-4034-a59c-20921cd6ffff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:48 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Volume f38de157-37c6-4aa1-86f5-d3f124225b56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38de157-37c6-4aa1-86f5-d3f124225b56', 'volume_size': 1} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1582363560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38de157-37c6-4aa1-86f5-d3f124225b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de092f296db2409e87fa257dd20c66e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:49Z,use_quota=True,user_id='ca64b221b701499a8068050d68b72b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Creating volume f38de157-37c6-4aa1-86f5-d3f124225b56 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:44:48 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:44:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:49 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56 1073741824 Jul 18 05:44:49 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:49 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d992fe-2ab9-421d-bdf0-fac00bd58e21]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:49 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d Jul 18 05:44:49 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:49 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56 1073741824" returned: 0 in 0.789s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:49 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56 Jul 18 05:44:49 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:50 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" returned: 0 in 0.707s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:50 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d Jul 18 05:44:50 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:50 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56" returned: 0 in 0.517s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7505b0af-bcbc-4034-a59c-20921cd6ffff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38de157-37c6-4aa1-86f5-d3f124225b56', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c0129c-cde3-46f5-a24a-e90a9ce3acec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:50 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Volume volume-f38de157-37c6-4aa1-86f5-d3f124225b56 (f38de157-37c6-4aa1-86f5-d3f124225b56): created successfully Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c0129c-cde3-46f5-a24a-e90a9ce3acec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Flow 'volume_create_manager' (15daf958-e92d-4bae-b0eb-d6cd73833c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:50 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-82e08026-95fb-4c3b-b779-29f271d4c1dc tempest-AttachVolumeTestJSON-2089319826 None] Created volume successfully. Jul 18 05:44:50 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" returned: 0 in 0.516s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-8c3eadd7-94af-47ad-82d1-aadb8bc34d5d" released by "delete_volume" :: held 1.336s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9c6b17-29ca-4e58-a46e-4c7695f13e8a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:50 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 Jul 18 05:44:50 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:51 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" returned: 0 in 0.465s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:51 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39 Jul 18 05:44:51 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:51 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" returned: 0 in 0.325s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-f0bdfd9d-cca8-4089-83e3-ae95de82ab39" released by "delete_volume" :: held 0.906s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['c14107b5-3fdb-4f6f-819e-1aeb3e2cd25c'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e6aaee81-811a-4bf5-8d45-89c6a585cedb req-667a7888-6e35-4fe9-a4ac-177bae9ecb5f tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e6aaee81-811a-4bf5-8d45-89c6a585cedb req-667a7888-6e35-4fe9-a4ac-177bae9ecb5f tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e6aaee81-811a-4bf5-8d45-89c6a585cedb req-667a7888-6e35-4fe9-a4ac-177bae9ecb5f tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:51 devstack cinder-volume[87497]: WARNING cinder.quota [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1761120418 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1761120418, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e6aaee81-811a-4bf5-8d45-89c6a585cedb req-667a7888-6e35-4fe9-a4ac-177bae9ecb5f tempest-AttachVolumeTestJSON-2089319826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-f38de157-37c6-4aa1-86f5-d3f124225b56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c124c53-e324-4ef3-85b6-07c94c16c439', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['061137e0-c738-497b-a905-fa342d11459f', '47e21af9-185f-459d-bdd7-6b24fe02e4b9', 'd50a942d-5bbe-4f11-bf1c-5c9d1963b418', 'da93dcbf-e22b-4c38-9271-89264f1458af'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:51 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-e6aaee81-811a-4bf5-8d45-89c6a585cedb req-667a7888-6e35-4fe9-a4ac-177bae9ecb5f tempest-AttachVolumeTestJSON-2089319826 None] attachment_update completed successfully. Jul 18 05:44:51 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['eda8fdab-4e57-4987-bb2b-6b13903503bd', '673cafa7-3e02-4cbc-a8f6-9cbcd1dadc34', '3092f7a2-ba34-4545-ac0a-dfd00cbc348b', '6e56e970-d12f-4998-b199-3927a58aa7c7'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:44:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:52 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:44:52 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:52 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.338s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:52 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:44:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6928c984-5e58-45a5-a3bb-45e3286bfe25 tempest-GroupSnapshotsTest-1276713363 None] Delete group completed successfully. Jul 18 05:44:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-651022a8-1de0-45b0-bc4e-43fe009260ba tempest-GroupSnapshotsTest-1276713363 None] Group tempest-GroupSnapshotsTest-Group-1857599993: creating Jul 18 05:44:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-651022a8-1de0-45b0-bc4e-43fe009260ba tempest-GroupSnapshotsTest-1276713363 None] Group tempest-GroupSnapshotsTest-Group-1857599993: created successfully Jul 18 05:44:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-651022a8-1de0-45b0-bc4e-43fe009260ba tempest-GroupSnapshotsTest-1276713363 None] Create group completed successfully. Jul 18 05:44:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-ea56fbe9-39a4-47a3-80c4-e6bef811b609 req-1b0a5ffb-fc82-46ab-af1a-2fec886a5bfe tempest-AttachVolumeTestJSON-2089319826 None] Terminate volume connection completed successfully. Jul 18 05:44:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-ea56fbe9-39a4-47a3-80c4-e6bef811b609 req-1b0a5ffb-fc82-46ab-af1a-2fec886a5bfe tempest-AttachVolumeTestJSON-2089319826 None] Deleting attachment b864de3e-1261-4d3f-8fa2-17b1cdb5b487. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:44:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-66fc78b8-a622-4ddd-ba28-a80f97e9af61 req-87da6b07-1be1-48f8-a749-872b12d20f63 tempest-AttachVolumeTestJSON-2089319826 None] Terminate volume connection completed successfully. Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-66fc78b8-a622-4ddd-ba28-a80f97e9af61 req-87da6b07-1be1-48f8-a749-872b12d20f63 tempest-AttachVolumeTestJSON-2089319826 None] Deleting attachment 1c124c53-e324-4ef3-85b6-07c94c16c439. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Flow 'volume_create_manager' (e9951ba4-ca5c-4fba-b26b-dc426a2961b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fae469-3868-44b6-b023-893dbdf950d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fae469-3868-44b6-b023-893dbdf950d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1273598022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50219295-6436-44a3-8e8f-344ed1a1e13e,host='devstack@QuobyteHD#QuobyteHD',id=eabea544-4bb5-434c-ba5e-af6fbe3e05e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b035644e4dc4dbb91733fe907939d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:55Z,use_quota=True,user_id='d02b9816fa1a4cc4b03e21aed6a82179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb79acee-8ac5-4d73-ab31-21c90317c9c0),volume_type_id=cb79acee-8ac5-4d73-ab31-21c90317c9c0)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72db8e1-a3f1-4271-a648-7642b1b338d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72db8e1-a3f1-4271-a648-7642b1b338d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033ef61f-5e88-465a-b8f7-5afaeb16cfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033ef61f-5e88-465a-b8f7-5afaeb16cfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eabea544-4bb5-434c-ba5e-af6fbe3e05e1', 'volume_name': 'volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf357bf-a5a5-46d6-9c08-fd7af1a650ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf357bf-a5a5-46d6-9c08-fd7af1a650ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bf0f4a-6cdf-4de0-b59a-cc6395b4c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:55 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Volume eabea544-4bb5-434c-ba5e-af6fbe3e05e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1', 'volume_size': 1} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=50219295-6436-44a3-8e8f-344ed1a1e13e,created_at=2026-07-18T03:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1273598022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50219295-6436-44a3-8e8f-344ed1a1e13e,host='devstack@QuobyteHD#QuobyteHD',id=eabea544-4bb5-434c-ba5e-af6fbe3e05e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b035644e4dc4dbb91733fe907939d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:44:55Z,use_quota=True,user_id='d02b9816fa1a4cc4b03e21aed6a82179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb79acee-8ac5-4d73-ab31-21c90317c9c0),volume_type_id=cb79acee-8ac5-4d73-ab31-21c90317c9c0)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Creating volume eabea544-4bb5-434c-ba5e-af6fbe3e05e1 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:44:55 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:44:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:55 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 1073741824 Jul 18 05:44:55 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:56 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 1073741824" returned: 0 in 0.602s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:56 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 Jul 18 05:44:56 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:56 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" returned: 0 in 0.293s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:44:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:44:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bf0f4a-6cdf-4de0-b59a-cc6395b4c58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bb7d32-b948-45f7-8af2-be885f9fe9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:44:56 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Volume volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 (eabea544-4bb5-434c-ba5e-af6fbe3e05e1): created successfully Jul 18 05:44:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bb7d32-b948-45f7-8af2-be885f9fe9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:44:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Flow 'volume_create_manager' (e9951ba4-ca5c-4fba-b26b-dc426a2961b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:44:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ae40d181-6924-488c-b657-071f2addc5c0 tempest-GroupSnapshotsTest-1276713363 None] Created volume successfully. Jul 18 05:44:58 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] GroupSnapshot ef322903-0bb4-42a0-9928-a35c76470f89: creating. Jul 18 05:44:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Group snapshot ef322903-0bb4-42a0-9928-a35c76470f89: creating. {{(pid=87497) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 18 05:44:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:44:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:44:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Creating offline snapshot 4a75595b-9627-4d81-abab-1e02eaea4243 of volume eabea544-4bb5-434c-ba5e-af6fbe3e05e1 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:44:58 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e175974c-5117-4ad5-b4f0-1ec140e05a23]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:44:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:58 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 Jul 18 05:44:58 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:59 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" returned: 0 in 0.560s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:59 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 1G Jul 18 05:44:59 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:59 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 18 05:44:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 1G" returned: 0 in 0.575s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:44:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:44:59 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 Jul 18 05:44:59 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:44:59 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243" returned: 0 in 0.415s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:00 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:00 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 Jul 18 05:45:00 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:00 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243" returned: 0 in 0.353s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:00 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.info Jul 18 05:45:00 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Flow 'volume_create_manager' (072d74ac-247e-40eb-84f0-646743dcc5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4043002-05e4-47e0-8981-a598a8f32812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4043002-05e4-47e0-8981-a598a8f32812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1556251162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41ad46a-fd4e-41d8-903f-9fd8aff6de0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21b8b48e074f20bd893b0f43484099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:00Z,use_quota=True,user_id='d37ba7036b574354845e90ec62f0b024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bdab51-bf68-4b32-bdf9-b02237830798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bdab51-bf68-4b32-bdf9-b02237830798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650b9064-85a7-4791-b710-2cff5e03a9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650b9064-85a7-4791-b710-2cff5e03a9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41ad46a-fd4e-41d8-903f-9fd8aff6de0b', 'volume_name': 'volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1798b1-bac4-4a56-9763-1124ac16de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1798b1-bac4-4a56-9763-1124ac16de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ac1e76-751d-49c0-a727-4940608ecc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:00 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Volume e41ad46a-fd4e-41d8-903f-9fd8aff6de0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b', 'volume_size': 1} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:00 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.info" returned: 0 in 0.303s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:00 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:00 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.info Jul 18 05:45:00 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:00 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.info" returned: 0 in 0.257s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1556251162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41ad46a-fd4e-41d8-903f-9fd8aff6de0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21b8b48e074f20bd893b0f43484099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:00Z,use_quota=True,user_id='d37ba7036b574354845e90ec62f0b024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Creating volume e41ad46a-fd4e-41d8-903f-9fd8aff6de0b {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:45:01 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:01 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b 1073741824 Jul 18 05:45:01 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "cinder-f38de157-37c6-4aa1-86f5-d3f124225b56-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-f38de157-37c6-4aa1-86f5-d3f124225b56-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:01 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-68f122b0-d146-4b2c-9eb7-04aa34b9a9bb tempest-GroupSnapshotsTest-1276713363 None] group_snapshot ef322903-0bb4-42a0-9928-a35c76470f89: created successfully Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "cinder-quobyte-f38de157-37c6-4aa1-86f5-d3f124225b56" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-quobyte-f38de157-37c6-4aa1-86f5-d3f124225b56" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ad0fa6-deb8-4843-99ce-146e2f6dc0e8]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:01 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56 Jul 18 05:45:01 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:01 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b 1073741824" returned: 0 in 0.620s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:01 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56" returned: 0 in 0.467s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:01 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56 Jul 18 05:45:01 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:01 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b Jul 18 05:45:01 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:01 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] group_snapshot ef322903-0bb4-42a0-9928-a35c76470f89: deleting Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] group_snapshot ef322903-0bb4-42a0-9928-a35c76470f89: deleting {{(pid=87497) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-4a75595b-9627-4d81-abab-1e02eaea4243" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-4a75595b-9627-4d81-abab-1e02eaea4243" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Deleting offline snapshot 4a75595b-9627-4d81-abab-1e02eaea4243 of volume eabea544-4bb5-434c-ba5e-af6fbe3e05e1 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:45:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] snapshot_file for this snap is: volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:45:02 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f38de157-37c6-4aa1-86f5-d3f124225b56" returned: 0 in 0.307s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bb5d73-031f-4a81-a725-b4aecce80013]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-quobyte-f38de157-37c6-4aa1-86f5-d3f124225b56" released by "delete_volume" :: held 0.842s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:02 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b" returned: 0 in 0.401s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ac1e76-751d-49c0-a727-4940608ecc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2940887-4115-4acc-beee-24f06b862fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Created reservations ['aabfd61d-b511-423d-9cb9-d8574de8aa8b', '4084e3ee-699f-4f90-afc3-57a9685ebbf8', 'ad9bb7b7-6a20-4934-ba55-6c250aa2e391', '68975bb4-cc85-42b0-9873-2f0f6a9489b7'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:02 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Volume volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b (e41ad46a-fd4e-41d8-903f-9fd8aff6de0b): created successfully Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2940887-4115-4acc-beee-24f06b862fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:02 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 Jul 18 05:45:02 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Flow 'volume_create_manager' (072d74ac-247e-40eb-84f0-646743dcc5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-24ad41fe-5f21-4826-9cde-8834f6e17a06 tempest-AttachVolumeNegativeTest-1948277789 None] Created volume successfully. Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:02 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:02 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:02 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243" returned: 0 in 0.511s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[87343c95-b5a9-41ab-aec3-a5028284c0a2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:02 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.473s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Deleted volume successfully. Jul 18 05:45:02 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 Jul 18 05:45:02 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f76c1fdb-2c4d-4718-a25c-50c800b85481 tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-f38de157-37c6-4aa1-86f5-d3f124225b56-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:03 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" returned: 0 in 0.514s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:03 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 Jul 18 05:45:03 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "cinder-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "cinder-quobyte-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-quobyte-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c045ea-19cc-41f7-891c-a471dca17032]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-8bfadc23-411e-45c5-8195-015b64259d4d req-a2dace3b-f2a0-4d5d-9580-f783eac807a8 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-8bfadc23-411e-45c5-8195-015b64259d4d req-a2dace3b-f2a0-4d5d-9580-f783eac807a8 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-8bfadc23-411e-45c5-8195-015b64259d4d req-a2dace3b-f2a0-4d5d-9580-f783eac807a8 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-8bfadc23-411e-45c5-8195-015b64259d4d req-a2dace3b-f2a0-4d5d-9580-f783eac807a8 tempest-AttachVolumeNegativeTest-1948277789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a656238f-cc70-4d56-a978-67dbed1ecf83', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:45:03 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 Jul 18 05:45:03 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:03 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243" returned: 0 in 0.668s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:03 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-8bfadc23-411e-45c5-8195-015b64259d4d req-a2dace3b-f2a0-4d5d-9580-f783eac807a8 tempest-AttachVolumeNegativeTest-1948277789 None] attachment_update completed successfully. Jul 18 05:45:03 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243 Jul 18 05:45:03 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:04 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5" returned: 0 in 0.541s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:04 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5 Jul 18 05:45:04 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:04 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1.4a75595b-9627-4d81-abab-1e02eaea4243" returned: 0 in 0.345s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-4a75595b-9627-4d81-abab-1e02eaea4243" released by "_delete_snapshot" :: held 2.253s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" released by "delete_snapshot" :: held 2.287s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:04 devstack cinder-volume[87497]: WARNING cinder.quota [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1959625916 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1959625916, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:45:04 devstack cinder-volume[87497]: WARNING cinder.quota [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1959625916 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1959625916, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['ac1010d2-31b7-488b-9e23-181ff5464f42', '9e0290a2-8583-4edc-8819-7fb8b8c848b5', 'dfdab370-1d53-4844-a8e3-8ca6be24325c', '90803bca-b2ac-4df8-86ca-d6b88bcce3ea'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:04 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5" returned: 0 in 0.349s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-quobyte-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5" released by "delete_volume" :: held 0.988s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:04 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-aaa748b6-1979-4c49-8d22-c0c29dd6be99 tempest-GroupSnapshotsTest-1276713363 None] group_snapshot ef322903-0bb4-42a0-9928-a35c76470f89: deleted successfully Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Created reservations ['a7b8fc93-8940-4fe8-9e99-f912ca0f0be7', 'fc22ea08-ae2f-451f-955b-a0ec6a952813', '644e0fca-762a-4d96-aab8-c430f69b22f3', '1d55df79-f0c7-470a-9c7f-f2edaa4ca58f'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:04 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:04 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:05 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.321s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Deleted volume successfully. Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-62af102f-6d3e-4a28-a5d0-307dce31fdc5 tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-531d96e7-ce29-4ec3-929e-76d9c2ccc6d5-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "cinder-quobyte-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" acquired by "delete_volume" :: waited 0.037s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e331efcf-608d-4639-8097-c132a3455a6a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "cinder-437eeaef-031e-4fdf-b92b-e6d97979b3d9-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-437eeaef-031e-4fdf-b92b-e6d97979b3d9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "cinder-quobyte-437eeaef-031e-4fdf-b92b-e6d97979b3d9" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-quobyte-437eeaef-031e-4fdf-b92b-e6d97979b3d9" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:06 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 Jul 18 05:45:06 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da6cf64-49ef-494f-905a-d07be3d2d4d8]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:06 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:06 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:06 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 Jul 18 05:45:06 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:06 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" returned: 0 in 0.600s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:06 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1 Jul 18 05:45:06 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:06 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.364s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 8 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:45:06 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-bc0a629c-e2ce-42d7-aa83-3db56c995e58 req-fde349b0-615a-46e0-accf-ee803f199df9 tempest-AttachVolumeNegativeTest-1948277789 None] Terminate volume connection completed successfully. Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-bc0a629c-e2ce-42d7-aa83-3db56c995e58 req-fde349b0-615a-46e0-accf-ee803f199df9 tempest-AttachVolumeNegativeTest-1948277789 None] Deleting attachment a656238f-cc70-4d56-a978-67dbed1ecf83. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:45:06 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9" returned: 0 in 0.705s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:06 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9 Jul 18 05:45:06 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:06 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" returned: 0 in 0.346s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Lock "cinder-quobyte-eabea544-4bb5-434c-ba5e-af6fbe3e05e1" released by "delete_volume" :: held 1.045s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['ec6349b1-f282-4035-813d-86303851e422'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:06 devstack cinder-volume[87497]: WARNING cinder.quota [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1959625916 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1959625916, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:45:06 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Created reservations ['c6fa2fb2-4083-4a03-9f25-279b8d3e10c5', '9091431b-2ea9-442b-99d5-bd4b065cfb9d', 'f0d1d140-17e3-4ca7-b5a8-3ce7bddf5ab6', '34c2e13f-8572-48fa-a355-c46c715ad5e3'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:07 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-437eeaef-031e-4fdf-b92b-e6d97979b3d9" returned: 0 in 0.355s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-quobyte-437eeaef-031e-4fdf-b92b-e6d97979b3d9" released by "delete_volume" :: held 1.110s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:07 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:07 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Created reservations ['beb4617a-309c-45a5-bde7-e9141017a908', '1d5c6984-d15e-489d-86b1-22466cbdb658', '17e02e5e-8917-4475-b622-f0fdec092082', 'e6eb9332-28e7-444a-a393-79717920ff06'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:07 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:07 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:07 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.318s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:07 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0b0601cd-b107-405f-b559-b39cd5049703 tempest-GroupSnapshotsTest-1276713363 None] Delete group completed successfully. Jul 18 05:45:07 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.308s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:07 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Deleted volume successfully. Jul 18 05:45:07 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5f3a1c37-2cb5-463f-8212-470b3be0110d tempest-AttachVolumeTestJSON-2089319826 None] Lock "cinder-437eeaef-031e-4fdf-b92b-e6d97979b3d9-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "cinder-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "cinder-quobyte-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-quobyte-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b" acquired by "delete_volume" :: waited 0.042s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:12 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e289d05b-2c8c-4543-99bf-b144dba8ed03]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:13 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b Jul 18 05:45:13 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:13 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b" returned: 0 in 0.505s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:13 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b Jul 18 05:45:13 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:13 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b" returned: 0 in 0.391s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-quobyte-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b" released by "delete_volume" :: held 0.981s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:13 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Created reservations ['3eda5616-7686-41f3-93f8-aea6ce500bbb', '939e35b6-c369-4a65-94b0-07919c636901', 'd8d00cbc-7c44-4162-8f0f-cc1fc4e18433', 'e1abd070-0477-4f5b-94b0-596bdb87425f'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:14 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:14 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Flow 'volume_create_manager' (fdafc3f0-18e5-48e1-b1ed-2c3e4b2cf0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a85a6c3-723a-4046-95f6-f4273e021879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a85a6c3-723a-4046-95f6-f4273e021879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a559ade-8b71-46eb-b357-34046612393a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcdabfb7fd3435eb5b1c8aa1d48dd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:14Z,use_quota=True,user_id='76cbe6f9cd0d47b7a895d416bba616f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(557e0af2-90f6-4b3d-85c8-097b79252406),volume_type_id=557e0af2-90f6-4b3d-85c8-097b79252406)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed671f6e-7f29-4d17-bee6-0598a02cf86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed671f6e-7f29-4d17-bee6-0598a02cf86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d822c01a-0ee6-45bf-a382-9bd4466444b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.image.glance [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Creating Keystone auth plugin from conf {{(pid=87497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 05:45:14 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.321s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Deleted volume successfully. Jul 18 05:45:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-81abaf04-cec4-4bd9-a287-26eebd2a7716 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-e41ad46a-fd4e-41d8-903f-9fd8aff6de0b-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "cinder-fb62f9d7-52ef-445d-b7b9-c9d5468f3053-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-fb62f9d7-52ef-445d-b7b9-c9d5468f3053-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "cinder-quobyte-fb62f9d7-52ef-445d-b7b9-c9d5468f3053" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-quobyte-fb62f9d7-52ef-445d-b7b9-c9d5468f3053" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb54c7fc-540b-4d72-9faf-dcdd186a745d]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:15 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 Jul 18 05:45:15 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d822c01a-0ee6-45bf-a382-9bd4466444b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a559ade-8b71-46eb-b357-34046612393a', 'volume_name': 'volume-1a559ade-8b71-46eb-b357-34046612393a', 'volume_size': 1, 'image_id': 'ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f916095fcefc749140646823a3f4bee0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fcdabfb7fd3435eb5b1c8aa1d48dd73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e227d716cacf4fd505fbd9e495b025310cb4c2315c951070998e239b0fd12d885c90ce41935ab7d3b23eee1b8122741c4b28bbb204c9489802fb6bc90f852207', 'id': 'ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'created_at': datetime.datetime(2026, 7, 18, 3, 45, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 45, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ccdca257-6009-485a-ab7b-b6fe5ab0f7fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c26070-5b92-4b80-b11e-a20fcf659e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c26070-5b92-4b80-b11e-a20fcf659e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b09e17b-e96b-4d66-b6e6-878937dae8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Volume 1a559ade-8b71-46eb-b357-34046612393a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a559ade-8b71-46eb-b357-34046612393a', 'volume_size': 1, 'image_id': 'ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f916095fcefc749140646823a3f4bee0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fcdabfb7fd3435eb5b1c8aa1d48dd73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e227d716cacf4fd505fbd9e495b025310cb4c2315c951070998e239b0fd12d885c90ce41935ab7d3b23eee1b8122741c4b28bbb204c9489802fb6bc90f852207', 'id': 'ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'created_at': datetime.datetime(2026, 7, 18, 3, 45, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 45, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ccdca257-6009-485a-ab7b-b6fe5ab0f7fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Trying to clone 1a559ade-8b71-46eb-b357-34046612393a from image ccdca257-6009-485a-ab7b-b6fe5ab0f7fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'metadata': {}}]). {{(pid=87497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 05:45:15 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Image download 0.00 MB at 0.00 MB/s Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7786c09b-2f82-40d8-83dc-5b18b63ca95d]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:15 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053" returned: 0 in 0.472s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:15 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053 Jul 18 05:45:15 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:15 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD Jul 18 05:45:15 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:16 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fb62f9d7-52ef-445d-b7b9-c9d5468f3053" returned: 0 in 0.335s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-quobyte-fb62f9d7-52ef-445d-b7b9-c9d5468f3053" released by "delete_volume" :: held 0.873s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:16 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Created reservations ['77884012-1a7a-4a7f-a4e0-3d7677082358', '22a91163-f170-464a-9d5a-9360c570820a', '78452e62-8063-4b08-89dc-ccd219fe7d1e', '616adacc-cb16-4e9e-9e74-ce68b871daca'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:16 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD Jul 18 05:45:16 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:16 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:16 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:16 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD" returned: 1 in 0.518s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Temporary image ccdca257-6009-485a-ab7b-b6fe5ab0f7fc is fetched for user 76cbe6f9cd0d47b7a895d416bba616f7. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 05:45:16 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.341s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:16 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Deleted volume successfully. Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aadfe902-34a7-4a9d-a5f3-12bdb8104805 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-fb62f9d7-52ef-445d-b7b9-c9d5468f3053-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "cinder-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9af584-a3e3-4619-bb29-1034507d76fb]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "cinder-quobyte-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-quobyte-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d517cf-4af3-4f3b-9b82-c073c4d98e7c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:17 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD Jul 18 05:45:17 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:17 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 Jul 18 05:45:17 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:17 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:17 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD Jul 18 05:45:17 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:17 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5" returned: 0 in 0.517s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:17 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5 Jul 18 05:45:17 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:17 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD" returned: 1 in 0.458s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a559ade-8b71-46eb-b357-34046612393a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fcdabfb7fd3435eb5b1c8aa1d48dd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:14Z,use_quota=True,user_id='76cbe6f9cd0d47b7a895d416bba616f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(557e0af2-90f6-4b3d-85c8-097b79252406),volume_type_id=557e0af2-90f6-4b3d-85c8-097b79252406)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Creating volume 1a559ade-8b71-46eb-b357-34046612393a {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:45:17 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:17 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5" returned: 0 in 0.288s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:17 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a 1073741824 Jul 18 05:45:17 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-quobyte-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5" released by "delete_volume" :: held 0.869s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:17 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Created reservations ['ecbb6652-09f7-4f0c-9d53-709a17b70d1c', 'e15bd481-5518-4cf1-b551-bd9427c612d4', '29d9ab13-c0af-45ac-a5fb-e87b1a5ff132', '6a559fed-631b-4c81-ad9b-b42b0e293b16'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:18 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:18 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:18 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.277s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Deleted volume successfully. Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07996fb4-a35b-489c-b6b7-e04b06db0413 tempest-AttachVolumeNegativeTest-1948277789 None] Lock "cinder-191f002b-3bb3-4db8-ae3a-a50d5ea35fa5-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:18 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a 1073741824" returned: 0 in 0.666s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:18 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a Jul 18 05:45:18 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:18 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a" returned: 0 in 0.340s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Attempting download of ccdca257-6009-485a-ab7b-b6fe5ab0f7fc ((None, [{'url': 'file:///opt/stack/data/glance/images/ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'metadata': {}}])) to volume 1a559ade-8b71-46eb-b357-34046612393a. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1276ae0-7a98-470f-9cb7-8f036c328e29]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_qrd_eje3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:19 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_qrd_eje3 Jul 18 05:45:19 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:19 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_qrd_eje3" returned: 0 in 0.393s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_qrd_eje3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:19 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_qrd_eje3 Jul 18 05:45:19 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:19 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_qrd_eje3" returned: 1 in 0.380s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_qrd_eje3' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:45:19 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb79c994-8e82-4d42-b323-592a05d7d3fc]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:19 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD Jul 18 05:45:19 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:20 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:20 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD Jul 18 05:45:20 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:20 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:45:20 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] ccdca257-6009-485a-ab7b-b6fe5ab0f7fc was raw, converting to qcow2 {{(pid=87497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 05:45:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:20 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a Jul 18 05:45:20 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:21 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a" returned: 0 in 0.647s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ccdca257-6009-485a-ab7b-b6fe5ab0f7fc_m_obz8ixdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:45:21 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Converted 0.00 MB image at 0.00 MB/s Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:21 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a 1G Jul 18 05:45:21 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:21 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a 1G" returned: 0 in 0.472s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Downloaded image ccdca257-6009-485a-ab7b-b6fe5ab0f7fc ((None, [{'url': 'file:///opt/stack/data/glance/images/ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'metadata': {}}])) to volume 1a559ade-8b71-46eb-b357-34046612393a successfully. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Temporary image ccdca257-6009-485a-ab7b-b6fe5ab0f7fc for user 76cbe6f9cd0d47b7a895d416bba616f7 is deleted. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Marking volume 1a559ade-8b71-46eb-b357-34046612393a as bootable. {{(pid=87497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Copying metadata from image ccdca257-6009-485a-ab7b-b6fe5ab0f7fc to 1a559ade-8b71-46eb-b357-34046612393a. {{(pid=87497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Creating volume glance metadata for volume 1a559ade-8b71-46eb-b357-34046612393a backed by image ccdca257-6009-485a-ab7b-b6fe5ab0f7fc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f916095fcefc749140646823a3f4bee0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b09e17b-e96b-4d66-b6e6-878937dae8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a559ade-8b71-46eb-b357-34046612393a', 'volume_size': 1, 'image_id': 'ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f916095fcefc749140646823a3f4bee0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fcdabfb7fd3435eb5b1c8aa1d48dd73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e227d716cacf4fd505fbd9e495b025310cb4c2315c951070998e239b0fd12d885c90ce41935ab7d3b23eee1b8122741c4b28bbb204c9489802fb6bc90f852207', 'id': 'ccdca257-6009-485a-ab7b-b6fe5ab0f7fc', 'created_at': datetime.datetime(2026, 7, 18, 3, 45, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 45, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ccdca257-6009-485a-ab7b-b6fe5ab0f7fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba412794-7a0b-4383-9da3-65e8b7fc223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Volume volume-1a559ade-8b71-46eb-b357-34046612393a (1a559ade-8b71-46eb-b357-34046612393a): created successfully Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba412794-7a0b-4383-9da3-65e8b7fc223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Flow 'volume_create_manager' (fdafc3f0-18e5-48e1-b1ed-2c3e4b2cf0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f759fe04-b11b-487f-a2a6-93caa5633f0a tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Created volume successfully. Jul 18 05:45:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Acquiring lock "cinder-1a559ade-8b71-46eb-b357-34046612393a-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "cinder-1a559ade-8b71-46eb-b357-34046612393a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Acquiring lock "cinder-quobyte-1a559ade-8b71-46eb-b357-34046612393a" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "cinder-quobyte-1a559ade-8b71-46eb-b357-34046612393a" acquired by "delete_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:23 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb671f86-0e36-4acd-a6ad-22c09025d467]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:23 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a Jul 18 05:45:23 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:23 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a" returned: 0 in 0.512s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:23 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a Jul 18 05:45:23 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:23 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1a559ade-8b71-46eb-b357-34046612393a" returned: 0 in 0.328s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "cinder-quobyte-1a559ade-8b71-46eb-b357-34046612393a" released by "delete_volume" :: held 0.896s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:23 devstack cinder-volume[87497]: WARNING cinder.quota [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:45:23 devstack cinder-volume[87497]: WARNING cinder.quota [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:45:23 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Created reservations ['61c78547-d642-49c7-a542-f9a5bdefa230', 'bff3a31b-62b9-4be1-902f-d02152cfd2a1', '3fddd7eb-a744-479f-bdd6-9aa12c6e7d7a', '7b8e6750-361b-4d40-a774-9b604c3e6eda'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:24 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:24 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:24 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.400s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:24 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:24 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Deleted volume successfully. Jul 18 05:45:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4ebc4c9-c2c5-4dcf-8c45-c05bdf6496dc tempest-VolumeAndVolumeTypeFromImageTest-2104876764 None] Lock "cinder-1a559ade-8b71-46eb-b357-34046612393a-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Flow 'volume_create_manager' (f57bbc46-68c7-4cc7-9009-ae5fee083a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06a3e51-856b-49cd-ab20-180fa58ca1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06a3e51-856b-49cd-ab20-180fa58ca1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-149032358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7cedc2292a45e3bb0686ce59e5ccb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:27Z,use_quota=True,user_id='74e644a87deb48fea3d37a9926741fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ab9407-3c93-407e-8553-41e13e4e6650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ab9407-3c93-407e-8553-41e13e4e6650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a977859-7047-4d8d-9a93-1778ca885af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a977859-7047-4d8d-9a93-1778ca885af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c', 'volume_name': 'volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7931df64-d017-48f9-b79b-c4b8d4ce1b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7931df64-d017-48f9-b79b-c4b8d4ce1b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e5ca3b-77cc-44c4-a225-3e553340ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:26 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Volume 10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c', 'volume_size': 1} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-149032358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7cedc2292a45e3bb0686ce59e5ccb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:27Z,use_quota=True,user_id='74e644a87deb48fea3d37a9926741fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Creating volume 10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:45:26 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:45:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:27 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c 1073741824 Jul 18 05:45:27 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:27 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c 1073741824" returned: 0 in 0.593s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:27 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c Jul 18 05:45:27 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:27 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c" returned: 0 in 0.329s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:45:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e5ca3b-77cc-44c4-a225-3e553340ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff8c4fe-103b-4260-9ca2-f9198b54bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:28 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Volume volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c (10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c): created successfully Jul 18 05:45:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff8c4fe-103b-4260-9ca2-f9198b54bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Flow 'volume_create_manager' (f57bbc46-68c7-4cc7-9009-ae5fee083a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:28 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-adf4322a-0625-497f-8c43-f75bc67582ac tempest-VolumesServicesTestJSON-335773088 None] Created volume successfully. Jul 18 05:45:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-93fdb46d-dd72-4ae1-bc3e-da728c00fff8 tempest-BackendsCapabilitiesAdminTestsJSON-2146306569 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87497) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 18 05:45:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-68aa107d-b0fb-4a14-b432-4dfbb76ab86a tempest-BackendsCapabilitiesAdminTestsJSON-2146306569 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87497) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Acquiring lock "cinder-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Lock "cinder-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Acquiring lock "cinder-quobyte-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Lock "cinder-quobyte-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8680c6bb-0af0-48b4-9224-7d34ca8910b7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:29 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c Jul 18 05:45:29 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:29 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c" returned: 0 in 0.402s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:29 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c Jul 18 05:45:29 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:29 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c" returned: 0 in 0.332s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Lock "cinder-quobyte-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c" released by "delete_volume" :: held 0.791s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Created reservations ['48462802-33cc-47c7-b3f6-f24cd05b27d1', 'ec565f84-9903-4cbf-8421-ecadde9fee9b', '00d12a21-28cf-4590-ab9e-5732addc26ab', '48678a7a-c3e5-4b45-a3ec-221e62aa6322'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:30 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:30 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:30 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.376s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Deleted volume successfully. Jul 18 05:45:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69a6977c-ccf9-4e2c-8511-1788f691be50 tempest-VolumesServicesTestJSON-335773088 None] Lock "cinder-10bc57b0-4e7a-427b-abe5-ce1b3fe2e57c-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Flow 'volume_create_manager' (a2f2f545-3b71-42ee-8f29-310559edddd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1f3d9f-0c26-42b1-a092-824fa646c3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1f3d9f-0c26-42b1-a092-824fa646c3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602d875d-94ec-4293-a3af-8736f8f9f97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a21715f0db4d7d953a688de4b7fff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:31Z,use_quota=True,user_id='889755d1ac084474ad5678b1cfb95b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45e2466-4133-4b3d-b59a-b29198efffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45e2466-4133-4b3d-b59a-b29198efffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9b661b-b0b8-4e6e-99ca-77a3d6d7b7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9b661b-b0b8-4e6e-99ca-77a3d6d7b7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602d875d-94ec-4293-a3af-8736f8f9f97c', 'volume_name': 'volume-602d875d-94ec-4293-a3af-8736f8f9f97c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73f093c-a3bf-46a4-9bd3-22687975f907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73f093c-a3bf-46a4-9bd3-22687975f907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c178f05-c530-42e1-b4a6-397127f545c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Volume 602d875d-94ec-4293-a3af-8736f8f9f97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602d875d-94ec-4293-a3af-8736f8f9f97c', 'volume_size': 1} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602d875d-94ec-4293-a3af-8736f8f9f97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a21715f0db4d7d953a688de4b7fff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:31Z,use_quota=True,user_id='889755d1ac084474ad5678b1cfb95b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Creating volume 602d875d-94ec-4293-a3af-8736f8f9f97c {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:45:31 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:31 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c 1073741824 Jul 18 05:45:31 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:31 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c 1073741824" returned: 0 in 0.628s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:31 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c Jul 18 05:45:31 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:32 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c" returned: 0 in 0.422s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:45:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c178f05-c530-42e1-b4a6-397127f545c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602d875d-94ec-4293-a3af-8736f8f9f97c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788ffa73-2539-4d93-b23f-93bcf463ffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Volume volume-602d875d-94ec-4293-a3af-8736f8f9f97c (602d875d-94ec-4293-a3af-8736f8f9f97c): created successfully Jul 18 05:45:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788ffa73-2539-4d93-b23f-93bcf463ffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Flow 'volume_create_manager' (a2f2f545-3b71-42ee-8f29-310559edddd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2ad4750b-06d1-4fbf-a9fa-e5aa295b1f11 tempest-CinderUnicodeTest-899445292 None] Created volume successfully. Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Flow 'volume_create_manager' (5edd89ec-6cfe-4c03-9a23-d6d92cdb40b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128811c8-a5e4-46fc-a4e4-4dadd4513586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128811c8-a5e4-46fc-a4e4-4dadd4513586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-134653385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893798f3-d4c4-4bb0-bf65-aad498f719f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a21715f0db4d7d953a688de4b7fff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:34Z,use_quota=True,user_id='889755d1ac084474ad5678b1cfb95b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a73219d-3c8d-4ccc-baa9-09ddb1144d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a73219d-3c8d-4ccc-baa9-09ddb1144d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7e016f-e32f-48f0-ba42-468929b545f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7e016f-e32f-48f0-ba42-468929b545f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '893798f3-d4c4-4bb0-bf65-aad498f719f3', 'volume_name': 'volume-893798f3-d4c4-4bb0-bf65-aad498f719f3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2da66b-30a9-4dbf-965c-cff2f1f323dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2da66b-30a9-4dbf-965c-cff2f1f323dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ced8d72-d3a8-42b4-b419-eb151518154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:33 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Volume 893798f3-d4c4-4bb0-bf65-aad498f719f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-893798f3-d4c4-4bb0-bf65-aad498f719f3', 'volume_size': 1} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-134653385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893798f3-d4c4-4bb0-bf65-aad498f719f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a21715f0db4d7d953a688de4b7fff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:34Z,use_quota=True,user_id='889755d1ac084474ad5678b1cfb95b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Creating volume 893798f3-d4c4-4bb0-bf65-aad498f719f3 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:45:33 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:45:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:34 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 1073741824 Jul 18 05:45:34 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:34 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 1073741824" returned: 0 in 0.637s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:34 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 Jul 18 05:45:34 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:34 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3" returned: 0 in 0.297s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:45:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ced8d72-d3a8-42b4-b419-eb151518154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-893798f3-d4c4-4bb0-bf65-aad498f719f3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c685e44-d7ae-4adf-9c26-cc7ecf89261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:35 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Volume volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 (893798f3-d4c4-4bb0-bf65-aad498f719f3): created successfully Jul 18 05:45:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c685e44-d7ae-4adf-9c26-cc7ecf89261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Flow 'volume_create_manager' (5edd89ec-6cfe-4c03-9a23-d6d92cdb40b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-3befde92-18c4-4d32-a2e2-2d01c5dda77d tempest-CinderUnicodeTest-899445292 None] Created volume successfully. Jul 18 05:45:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c41fa4c8-8790-482f-9b5d-5882c01f08ef tempest-GroupsV314Test-1556947463 None] Group tempest-GroupsV314Test-Group-1722373660: creating Jul 18 05:45:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c41fa4c8-8790-482f-9b5d-5882c01f08ef tempest-GroupsV314Test-1556947463 None] Group tempest-GroupsV314Test-Group-1722373660: created successfully Jul 18 05:45:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c41fa4c8-8790-482f-9b5d-5882c01f08ef tempest-GroupsV314Test-1556947463 None] Create group completed successfully. Jul 18 05:45:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Creating offline snapshot ecddbb4c-e465-4637-8a93-a5f5c5c7e78e of volume 893798f3-d4c4-4bb0-bf65-aad498f719f3 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:45:36 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac0c907-7b80-41d2-ba97-d7c0858ae97e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:36 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 Jul 18 05:45:36 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:36 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3" returned: 0 in 0.388s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:36 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e 1G Jul 18 05:45:36 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:37 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e 1G" returned: 0 in 0.516s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:37 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e Jul 18 05:45:37 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:37 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e" returned: 0 in 0.419s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:37 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e is being set with open permissions: ugo+rw Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:37 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e Jul 18 05:45:37 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Flow 'volume_create_manager' (5556a1e9-92a2-4551-a72f-72b142835018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13f7a5c-fd1b-4a8f-99fb-250b4965dd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13f7a5c-fd1b-4a8f-99fb-250b4965dd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-612823559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a07a1a21-b82e-412d-ab6a-3c9206c80026,host='devstack@QuobyteHD#QuobyteHD',id=756951f7-ffd0-44ae-a470-ff7d32d7dd84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63ead5a676845b2ac2287df9a055809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:38Z,use_quota=True,user_id='97f983b2412147238afb2ad5b0e84951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5062c81e-a396-4b26-9d54-2a9f451bf1c2),volume_type_id=5062c81e-a396-4b26-9d54-2a9f451bf1c2)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47f348b-3ecb-439d-bd16-01b7729e5058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47f348b-3ecb-439d-bd16-01b7729e5058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc81b98-bb45-45f2-9fa0-92c757d97d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc81b98-bb45-45f2-9fa0-92c757d97d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756951f7-ffd0-44ae-a470-ff7d32d7dd84', 'volume_name': 'volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491c23f5-7e0c-4bca-9ccf-707e8180771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491c23f5-7e0c-4bca-9ccf-707e8180771d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d1f2c1-13a7-4d88-bace-fc2f945d9c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:37 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Volume 756951f7-ffd0-44ae-a470-ff7d32d7dd84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84', 'volume_size': 1} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:37 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e" returned: 0 in 0.300s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:37 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.info Jul 18 05:45:37 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:38 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.info" returned: 0 in 0.261s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:38 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.info is being set with open permissions: ugo+rw Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:38 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.info Jul 18 05:45:38 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:38 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.info" returned: 0 in 0.295s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a07a1a21-b82e-412d-ab6a-3c9206c80026,created_at=2026-07-18T03:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-612823559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a07a1a21-b82e-412d-ab6a-3c9206c80026,host='devstack@QuobyteHD#QuobyteHD',id=756951f7-ffd0-44ae-a470-ff7d32d7dd84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63ead5a676845b2ac2287df9a055809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:38Z,use_quota=True,user_id='97f983b2412147238afb2ad5b0e84951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5062c81e-a396-4b26-9d54-2a9f451bf1c2),volume_type_id=5062c81e-a396-4b26-9d54-2a9f451bf1c2)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Creating volume 756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:45:38 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:45:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:38 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 1073741824 Jul 18 05:45:38 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:38 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-bbe681a3-eec9-404c-8c1e-36e7d918f4a7 tempest-CinderUnicodeTest-899445292 None] Create snapshot completed successfully Jul 18 05:45:38 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4d8f4740-8260-47b5-9cd6-cc5836dbd30a tempest-GroupsTest-1760537783 None] Group tempest-Group1-1260842608: creating Jul 18 05:45:38 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4d8f4740-8260-47b5-9cd6-cc5836dbd30a tempest-GroupsTest-1760537783 None] Group tempest-Group1-1260842608: created successfully Jul 18 05:45:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4d8f4740-8260-47b5-9cd6-cc5836dbd30a tempest-GroupsTest-1760537783 None] Create group completed successfully. Jul 18 05:45:39 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 1073741824" returned: 0 in 0.531s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:39 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 Jul 18 05:45:39 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "cinder-ecddbb4c-e465-4637-8a93-a5f5c5c7e78e-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:39 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84" returned: 0 in 0.339s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-ecddbb4c-e465-4637-8a93-a5f5c5c7e78e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "cinder-quobyte-893798f3-d4c4-4bb0-bf65-aad498f719f3" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d1f2c1-13a7-4d88-bace-fc2f945d9c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3303b4c-d06e-4178-883a-857cd89dee0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-quobyte-893798f3-d4c4-4bb0-bf65-aad498f719f3" acquired by "delete_snapshot" :: waited 0.090s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "cinder-quobyte-ecddbb4c-e465-4637-8a93-a5f5c5c7e78e" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:39 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Volume volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 (756951f7-ffd0-44ae-a470-ff7d32d7dd84): created successfully Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3303b4c-d06e-4178-883a-857cd89dee0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Flow 'volume_create_manager' (5556a1e9-92a2-4551-a72f-72b142835018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-quobyte-ecddbb4c-e465-4637-8a93-a5f5c5c7e78e" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Deleting offline snapshot ecddbb4c-e465-4637-8a93-a5f5c5c7e78e of volume 893798f3-d4c4-4bb0-bf65-aad498f719f3 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] snapshot_file for this snap is: volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Flow 'volume_create_manager' (42e394e9-58bf-46c2-94ba-56d1e7effb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8390259-e269-45e6-b730-3cfb1316144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12051d-2631-4b33-94af-38e6b2c936a9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-19825838-2c60-4e38-a196-8c13575ffa5a tempest-GroupsV314Test-1556947463 None] Created volume successfully. Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8390259-e269-45e6-b730-3cfb1316144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1293582679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410eab3a-8112-49b0-af6a-67cf96f2cae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fbc1c209c7422da5d5b264d8dcbe71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:39Z,use_quota=True,user_id='8421fdbc088a4baaa3f0e953df33b7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9be08f-a252-41da-897f-e12505a4e209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9be08f-a252-41da-897f-e12505a4e209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dcc688-a4d9-4e16-b71e-5dc359ca9c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dcc688-a4d9-4e16-b71e-5dc359ca9c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410eab3a-8112-49b0-af6a-67cf96f2cae0', 'volume_name': 'volume-410eab3a-8112-49b0-af6a-67cf96f2cae0', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc64d6f-3bcc-489e-bc27-471397d3bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc64d6f-3bcc-489e-bc27-471397d3bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8dde89-ca91-4e2e-984d-d65634f01928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:39 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Volume 410eab3a-8112-49b0-af6a-67cf96f2cae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410eab3a-8112-49b0-af6a-67cf96f2cae0', 'volume_size': 1} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1293582679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410eab3a-8112-49b0-af6a-67cf96f2cae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fbc1c209c7422da5d5b264d8dcbe71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:39Z,use_quota=True,user_id='8421fdbc088a4baaa3f0e953df33b7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Creating volume 410eab3a-8112-49b0-af6a-67cf96f2cae0 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:45:39 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:45:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8f28707a-1073-4c6a-ab37-2ab7a0fbd0c0 tempest-GroupsTest-1760537783 None] Group tempest-Group2-2143877943: creating Jul 18 05:45:39 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e Jul 18 05:45:39 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:39 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 1073741824 Jul 18 05:45:39 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8f28707a-1073-4c6a-ab37-2ab7a0fbd0c0 tempest-GroupsTest-1760537783 None] Group tempest-Group2-2143877943: created successfully Jul 18 05:45:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8f28707a-1073-4c6a-ab37-2ab7a0fbd0c0 tempest-GroupsTest-1760537783 None] Create group completed successfully. Jul 18 05:45:40 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e" returned: 0 in 0.383s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-893798f3-d4c4-4bb0-bf65-aad498f719f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a767e165-d10d-48cb-b886-f378556ce8f2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:40 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:40 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 Jul 18 05:45:40 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 1073741824" returned: 0 in 0.439s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:40 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 Jul 18 05:45:40 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:40 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3" returned: 0 in 0.458s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:40 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0" returned: 0 in 0.339s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:40 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e Jul 18 05:45:40 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8dde89-ca91-4e2e-984d-d65634f01928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410eab3a-8112-49b0-af6a-67cf96f2cae0', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5236ce-7a03-4634-b47a-244e5a854322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:40 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Volume volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 (410eab3a-8112-49b0-af6a-67cf96f2cae0): created successfully Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5236ce-7a03-4634-b47a-244e5a854322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Flow 'volume_create_manager' (42e394e9-58bf-46c2-94ba-56d1e7effb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b8deb23d-c6a6-4aa0-9095-ac9942d79438 tempest-SnapshotMetadataTestJSON-1305281402 None] Created volume successfully. Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:40 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Cloning volume 756951f7-ffd0-44ae-a470-ff7d32d7dd84 to volume f7eeb3b6-7782-46e5-ad17-2056bf66c903 Jul 18 05:45:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Creating offline snapshot 56b85c7b-cffa-4d02-920a-e8fe80142f68 of volume 756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:45:41 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e" returned: 0 in 0.480s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1574bedb-fcc2-4fc7-9f6b-c907ab4ae47e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:41 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e Jul 18 05:45:41 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Flow 'volume_create_manager' (5c76baa6-2833-42bb-8315-94bad8c34e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6241960a-1064-445f-a424-6f211772dd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:41 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 Jul 18 05:45:41 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6241960a-1064-445f-a424-6f211772dd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779242901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5083d350-ce33-4ac7-8d5f-52c62ec45d7b,host='devstack@QuobyteHD#QuobyteHD',id=201758c4-a02f-4514-ad61-987369d27537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84c9828609c46e3a9f0a0530ecbb3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:41Z,use_quota=True,user_id='7c680cf7438147d4a00b5d8040b62e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c2dac8e-24a0-48d3-8886-6e08426edf6e),volume_type_id=4c2dac8e-24a0-48d3-8886-6e08426edf6e)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf0f15a-ebdb-4729-9596-d74f9597a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf0f15a-ebdb-4729-9596-d74f9597a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cb3c40-1a99-4b06-8ee5-a3a272af3187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cb3c40-1a99-4b06-8ee5-a3a272af3187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201758c4-a02f-4514-ad61-987369d27537', 'volume_name': 'volume-201758c4-a02f-4514-ad61-987369d27537', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a569ae-63f0-4870-8d5a-f4358d47a101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a569ae-63f0-4870-8d5a-f4358d47a101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65d61a6-5269-4599-a39d-e833595ddc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:41 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Volume 201758c4-a02f-4514-ad61-987369d27537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201758c4-a02f-4514-ad61-987369d27537', 'volume_size': 1} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:41 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3.ecddbb4c-e465-4637-8a93-a5f5c5c7e78e" returned: 0 in 0.372s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-quobyte-ecddbb4c-e465-4637-8a93-a5f5c5c7e78e" released by "_delete_snapshot" :: held 1.866s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-quobyte-893798f3-d4c4-4bb0-bf65-aad498f719f3" released by "delete_snapshot" :: held 1.922s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Created reservations ['3aeb1e08-0f7a-4e31-9d17-e495d72d1b45', '6e714c4f-5b7e-4d48-834f-453f6db22f36', '92bb2abf-2639-4e70-ba59-30e138487fb0', '177d011c-de60-4a60-acf6-195c765b9359'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:41 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84" returned: 0 in 0.499s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:41 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 1G Jul 18 05:45:41 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:41 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Delete snapshot completed successfully. Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8f4caf0b-f1e1-4296-8518-42bc81f92229 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-ecddbb4c-e465-4637-8a93-a5f5c5c7e78e-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:41 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 1G" returned: 0 in 0.439s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:42 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 Jul 18 05:45:42 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "cinder-893798f3-d4c4-4bb0-bf65-aad498f719f3-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-893798f3-d4c4-4bb0-bf65-aad498f719f3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "cinder-quobyte-893798f3-d4c4-4bb0-bf65-aad498f719f3" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-quobyte-893798f3-d4c4-4bb0-bf65-aad498f719f3" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5eaefd-5329-4424-9d9f-17b0f3459169]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:42 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 Jul 18 05:45:42 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:42 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68" returned: 0 in 0.315s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:42 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:42 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 Jul 18 05:45:42 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:42 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:42 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3" returned: 0 in 0.422s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:42 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3 Jul 18 05:45:42 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:42 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.info Jul 18 05:45:42 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:42 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-893798f3-d4c4-4bb0-bf65-aad498f719f3" returned: 0 in 0.285s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-quobyte-893798f3-d4c4-4bb0-bf65-aad498f719f3" released by "delete_volume" :: held 0.765s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:42 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.info" returned: 0 in 0.261s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:42 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:42 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.info Jul 18 05:45:42 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:42 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Created reservations ['aebc506a-af03-4337-b0ef-d244f1569513', 'c1eab669-097b-419f-bf08-4a5fb61fd180', 'ac55ccf3-c246-4c32-a375-7c3bc589d649', '54a90917-2dd4-440b-9f60-5388ccefb635'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:43 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:43 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:43 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.info" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Acquiring lock "cinder-quobyte-f7eeb3b6-7782-46e5-ad17-2056bf66c903" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Lock "cinder-quobyte-f7eeb3b6-7782-46e5-ad17-2056bf66c903" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] snapshot: 56b85c7b-cffa-4d02-920a-e8fe80142f68, volume: f7eeb3b6-7782-46e5-ad17-2056bf66c903, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "cinder-602d875d-94ec-4293-a3af-8736f8f9f97c-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d51a451-a523-41b3-ac90-32071b3717e7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-602d875d-94ec-4293-a3af-8736f8f9f97c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:43 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.296s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Deleted volume successfully. Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "cinder-quobyte-602d875d-94ec-4293-a3af-8736f8f9f97c" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa98714d-4b0f-4c87-8a8a-7872ac9f7750 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-893798f3-d4c4-4bb0-bf65-aad498f719f3-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-quobyte-602d875d-94ec-4293-a3af-8736f8f9f97c" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[295e1685-4e31-42e4-ae0f-4bfa4445437b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:43 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 Jul 18 05:45:43 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:43 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c Jul 18 05:45:43 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:43 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68" returned: 0 in 0.420s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e08bca4-2913-42bf-8c8c-c637b05a71d8]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:43 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c" returned: 0 in 0.441s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:43 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 Jul 18 05:45:43 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:43 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c Jul 18 05:45:43 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:44 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-602d875d-94ec-4293-a3af-8736f8f9f97c" returned: 0 in 0.248s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:44 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84" returned: 0 in 0.396s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-quobyte-602d875d-94ec-4293-a3af-8736f8f9f97c" released by "delete_volume" :: held 0.746s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:44 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 Jul 18 05:45:44 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Created reservations ['be21815f-cbff-42b1-a04d-3bf9b12775e5', '4333d7ca-840d-4aa0-83f3-539189c0b32b', '4ce30419-e616-4ed6-abc0-e59bb0382a98', '70b8e81b-1f61-49a3-823f-4579c7b4e009'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:44 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:44 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:44 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.271s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:44 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Deleted volume successfully. Jul 18 05:45:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38561d53-008a-437d-9aea-6b88b53f00c0 tempest-CinderUnicodeTest-899445292 None] Lock "cinder-602d875d-94ec-4293-a3af-8736f8f9f97c-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:49 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903" returned: 0 in 5.093s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:49 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419f372-ddc6-46fa-b615-711fe4f9b6d4]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:49 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 Jul 18 05:45:49 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:49 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84" returned: 0 in 0.557s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:49 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:45:49 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Converted 1024.00 MB image at 201.02 MB/s Jul 18 05:45:49 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 05:45:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:49 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 Jul 18 05:45:49 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:50 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903" returned: 0 in 0.296s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Lock "cinder-quobyte-f7eeb3b6-7782-46e5-ad17-2056bf66c903" released by "_copy_volume_from_snapshot" :: held 6.872s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=161,cinder:UPDATE=184,cinder:INSERT=51,cinder:DELETE=9 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Acquiring lock "cinder-quobyte-56b85c7b-cffa-4d02-920a-e8fe80142f68" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Lock "cinder-quobyte-56b85c7b-cffa-4d02-920a-e8fe80142f68" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Deleting offline snapshot 56b85c7b-cffa-4d02-920a-e8fe80142f68 of volume 756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] snapshot_file for this snap is: volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee0bfce-3788-4354-9756-9985dfaf4817]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:50 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 Jul 18 05:45:50 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:50 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68" returned: 0 in 0.419s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[878aeffa-d64c-4f17-aab9-d050fe649553]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:50 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 Jul 18 05:45:50 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:51 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84" returned: 0 in 0.392s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:51 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 Jul 18 05:45:51 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:51 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68" returned: 0 in 0.353s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:51 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68 Jul 18 05:45:51 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:51 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84.56b85c7b-cffa-4d02-920a-e8fe80142f68" returned: 0 in 0.268s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Lock "cinder-quobyte-56b85c7b-cffa-4d02-920a-e8fe80142f68" released by "_delete_snapshot" :: held 1.532s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=175,cinder:UPDATE=186,cinder:INSERT=46,cinder:DELETE=12 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.721s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.346s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5083d350-ce33-4ac7-8d5f-52c62ec45d7b,created_at=2026-07-18T03:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779242901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5083d350-ce33-4ac7-8d5f-52c62ec45d7b,host='devstack@QuobyteHD#QuobyteHD',id=201758c4-a02f-4514-ad61-987369d27537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84c9828609c46e3a9f0a0530ecbb3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:41Z,use_quota=True,user_id='7c680cf7438147d4a00b5d8040b62e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c2dac8e-24a0-48d3-8886-6e08426edf6e),volume_type_id=4c2dac8e-24a0-48d3-8886-6e08426edf6e)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Creating volume 201758c4-a02f-4514-ad61-987369d27537 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:45:51 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:45:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:51 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537 1073741824 Jul 18 05:45:51 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:51 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4630b2fe-1b37-441e-9e72-5d2046530ff4 tempest-GroupsV314Test-1556947463 None] Create group from source-group-a07a1a21-b82e-412d-ab6a-3c9206c80026 completed successfully. Jul 18 05:45:52 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537 1073741824" returned: 0 in 0.454s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:52 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537 Jul 18 05:45:52 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:52 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537" returned: 0 in 0.265s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.711s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65d61a6-5269-4599-a39d-e833595ddc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201758c4-a02f-4514-ad61-987369d27537', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2455caa-283d-4abe-bae3-a43279f49c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Creating offline snapshot c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 of volume 410eab3a-8112-49b0-af6a-67cf96f2cae0 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:45:52 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Volume volume-201758c4-a02f-4514-ad61-987369d27537 (201758c4-a02f-4514-ad61-987369d27537): created successfully Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2455caa-283d-4abe-bae3-a43279f49c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Flow 'volume_create_manager' (5c76baa6-2833-42bb-8315-94bad8c34e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c256ebc5-08c4-4b48-8bd4-3becfdbbe02b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f1517693-a382-48e1-98db-8fb992921c30 tempest-GroupsTest-1760537783 None] Created volume successfully. Jul 18 05:45:52 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 Jul 18 05:45:52 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:52 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0" returned: 0 in 0.401s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:52 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 1G Jul 18 05:45:52 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Acquiring lock "cinder-quobyte-f7eeb3b6-7782-46e5-ad17-2056bf66c903" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Lock "cinder-quobyte-f7eeb3b6-7782-46e5-ad17-2056bf66c903" acquired by "delete_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7898cda4-fd69-4352-9fec-bda6a0d79aad]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:53 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 Jul 18 05:45:53 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:53 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 1G" returned: 0 in 0.602s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:53 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 Jul 18 05:45:53 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:53 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903" returned: 0 in 0.475s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:53 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903 Jul 18 05:45:53 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:53 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2" returned: 0 in 0.380s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:53 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 is being set with open permissions: ugo+rw Jul 18 05:45:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:53 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 Jul 18 05:45:53 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:54 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f7eeb3b6-7782-46e5-ad17-2056bf66c903" returned: 0 in 0.290s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Lock "cinder-quobyte-f7eeb3b6-7782-46e5-ad17-2056bf66c903" released by "delete_volume" :: held 0.827s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Created reservations ['7361ce4c-22fd-42ea-8e26-3c0c1df5e455'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Acquiring lock "cinder-quobyte-201758c4-a02f-4514-ad61-987369d27537" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Lock "cinder-quobyte-201758c4-a02f-4514-ad61-987369d27537" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:54 devstack cinder-volume[87497]: WARNING cinder.quota [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1982339598 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1982339598, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:45:54 devstack cinder-volume[87497]: WARNING cinder.quota [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1982339598 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1982339598, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37d8f6e-82ee-47ce-88b1-468787249d43]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:54 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2" returned: 0 in 0.359s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Created reservations ['5dd143aa-814d-4b43-8705-b76f077fe688', 'b7f14606-2667-4479-8d5c-5434766edffb', 'fdd1f8eb-6781-4b45-9ee9-fdb4d7a6e145', 'f8b5c338-60df-4998-b14b-0a816a5c019b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:54 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.info Jul 18 05:45:54 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:54 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537 Jul 18 05:45:54 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:54 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:54 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:54 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.info" returned: 0 in 0.566s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:54 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.info is being set with open permissions: ugo+rw Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:54 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.396s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:54 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c57ec5de-4805-4b33-92e6-dfb95df230cd tempest-GroupsV314Test-1556947463 None] Delete group completed successfully. Jul 18 05:45:54 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.info Jul 18 05:45:54 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:54 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537" returned: 0 in 0.742s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:55 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537 Jul 18 05:45:55 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:55 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.info" returned: 0 in 0.328s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.794s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:55 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-201758c4-a02f-4514-ad61-987369d27537" returned: 0 in 0.271s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Lock "cinder-quobyte-201758c4-a02f-4514-ad61-987369d27537" released by "delete_volume" :: held 1.072s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0a5a01b2-a4a0-4141-882d-127730f0bdfa tempest-SnapshotMetadataTestJSON-1305281402 None] Create snapshot completed successfully Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Created reservations ['d1ec069a-b159-4eca-bff9-464446163972'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:55 devstack cinder-volume[87497]: WARNING cinder.quota [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1251338728 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1251338728, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:45:55 devstack cinder-volume[87497]: WARNING cinder.quota [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1251338728 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1251338728, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Created reservations ['624eab46-b3cf-465c-a5f3-c62a7cc9b096', '913c381c-edbc-4674-bbca-6b3a68e947f2', '6703d6cb-de8d-4276-b9fe-e35e4dad2b2c', '5d98cf1d-edb2-4772-83bd-f45928989e85'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:55 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:55 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] Created reservations ['a85ebd10-a0ea-41a2-b94b-972c002ac931'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:55 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.355s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-af0a27cc-c5d3-46c6-85aa-fda0467ed281 tempest-GroupsTest-1760537783 None] Delete group completed successfully. Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:56 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:56 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Acquiring lock "cinder-quobyte-756951f7-ffd0-44ae-a470-ff7d32d7dd84" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Lock "cinder-quobyte-756951f7-ffd0-44ae-a470-ff7d32d7dd84" acquired by "delete_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed0232-0bad-4097-a294-ffc6a0c0f354]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:56 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.365s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:56 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 Jul 18 05:45:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1001c0c1-0ee4-4c59-9e56-0b87777fe5db tempest-GroupsTest-1760537783 None] Delete group completed successfully. Jul 18 05:45:56 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Acquiring lock "cinder-c8d00fc1-15a3-4cea-bd8e-954ea8100ca2-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-c8d00fc1-15a3-4cea-bd8e-954ea8100ca2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Acquiring lock "cinder-quobyte-410eab3a-8112-49b0-af6a-67cf96f2cae0" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-quobyte-410eab3a-8112-49b0-af6a-67cf96f2cae0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Acquiring lock "cinder-quobyte-c8d00fc1-15a3-4cea-bd8e-954ea8100ca2" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-quobyte-c8d00fc1-15a3-4cea-bd8e-954ea8100ca2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Deleting offline snapshot c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 of volume 410eab3a-8112-49b0-af6a-67cf96f2cae0 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:45:56 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] snapshot_file for this snap is: volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84" returned: 0 in 0.523s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddc6c0d-7c4c-47ad-a8d3-295e74ca20f0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:56 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84 Jul 18 05:45:56 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:56 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 Jul 18 05:45:56 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:57 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-756951f7-ffd0-44ae-a470-ff7d32d7dd84" returned: 0 in 0.314s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Lock "cinder-quobyte-756951f7-ffd0-44ae-a470-ff7d32d7dd84" released by "delete_volume" :: held 0.945s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Created reservations ['a25ffd0f-6850-4bb7-b449-f9558b451419'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Created reservations ['37175a34-e52c-4409-8dbf-8cadb1655d0f', 'df74c69d-4fcf-4661-af87-66860c80cf3e', 'da33ef68-9978-4a21-a99c-f3da06c3094c', '600777be-3a40-41a7-babc-9fb89d9e4387'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:57 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2" returned: 0 in 0.516s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-410eab3a-8112-49b0-af6a-67cf96f2cae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2307d3fc-685f-4b98-a1f5-f80d269f3b4f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:57 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 Jul 18 05:45:57 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:57 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:45:57 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-282d6150-ab18-46e3-8302-978def156ecc tempest-GroupsTest-1760537783 None] Group tempest-GroupsTest-Group-1986134627: creating Jul 18 05:45:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-282d6150-ab18-46e3-8302-978def156ecc tempest-GroupsTest-1760537783 None] Group tempest-GroupsTest-Group-1986134627: created successfully Jul 18 05:45:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-282d6150-ab18-46e3-8302-978def156ecc tempest-GroupsTest-1760537783 None] Create group completed successfully. Jul 18 05:45:57 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0" returned: 0 in 0.556s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:57 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 Jul 18 05:45:57 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:57 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.478s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:57 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:45:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e3927fc1-0e96-4e21-a03b-215dc31d3a1c tempest-GroupsV314Test-1556947463 None] Delete group completed successfully. Jul 18 05:45:58 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2" returned: 0 in 0.399s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:58 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2 Jul 18 05:45:58 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:45:58 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Jul 18 05:45:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0.c8d00fc1-15a3-4cea-bd8e-954ea8100ca2" returned: 0 in 0.261s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:45:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-quobyte-c8d00fc1-15a3-4cea-bd8e-954ea8100ca2" released by "_delete_snapshot" :: held 1.925s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-quobyte-410eab3a-8112-49b0-af6a-67cf96f2cae0" released by "delete_snapshot" :: held 1.967s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:58 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Created reservations ['ff863bbc-7144-4622-af07-e0fef4284d90', 'db30c435-62d6-4ee6-9eb7-0aaa141de9c1', '91d54ce7-bf85-41fe-a047-0a9b7fb22f46', 'bc118676-a278-418c-b259-61254ee08d7d'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:45:58 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Delete snapshot completed successfully. Jul 18 05:45:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ba9c3105-517f-4049-95e1-e636951410bd tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-c8d00fc1-15a3-4cea-bd8e-954ea8100ca2-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Flow 'volume_create_manager' (83822df7-d7e7-471a-842c-4ee0746a09a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f1fd3c-c11d-4eec-a45a-0d0ed74525bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f1fd3c-c11d-4eec-a45a-0d0ed74525bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919335324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6f68363-4dad-452e-9950-3e2b93a80e68,host='devstack@QuobyteHD#QuobyteHD',id=e38d5cd6-379d-48a0-957d-0a82e6cc4057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84c9828609c46e3a9f0a0530ecbb3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:59Z,use_quota=True,user_id='7c680cf7438147d4a00b5d8040b62e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd574d42-1641-4c87-b839-7de1e40d2a68),volume_type_id=fd574d42-1641-4c87-b839-7de1e40d2a68)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5676a91-eef7-4034-af52-3de17297ce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5676a91-eef7-4034-af52-3de17297ce98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822fc3fd-5f25-4c37-8eec-4c8781d3b613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822fc3fd-5f25-4c37-8eec-4c8781d3b613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38d5cd6-379d-48a0-957d-0a82e6cc4057', 'volume_name': 'volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43c76d4-9405-46ea-9e5f-770066db71bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43c76d4-9405-46ea-9e5f-770066db71bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16895109-ee66-48fb-81c2-e2cc358a7b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:45:59 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Volume e38d5cd6-379d-48a0-957d-0a82e6cc4057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057', 'volume_size': 1} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6f68363-4dad-452e-9950-3e2b93a80e68,created_at=2026-07-18T03:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919335324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6f68363-4dad-452e-9950-3e2b93a80e68,host='devstack@QuobyteHD#QuobyteHD',id=e38d5cd6-379d-48a0-957d-0a82e6cc4057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84c9828609c46e3a9f0a0530ecbb3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:45:59Z,use_quota=True,user_id='7c680cf7438147d4a00b5d8040b62e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd574d42-1641-4c87-b839-7de1e40d2a68),volume_type_id=fd574d42-1641-4c87-b839-7de1e40d2a68)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Creating volume e38d5cd6-379d-48a0-957d-0a82e6cc4057 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:45:59 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:45:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:45:59 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 1073741824 Jul 18 05:45:59 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Acquiring lock "cinder-410eab3a-8112-49b0-af6a-67cf96f2cae0-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-410eab3a-8112-49b0-af6a-67cf96f2cae0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Acquiring lock "cinder-quobyte-410eab3a-8112-49b0-af6a-67cf96f2cae0" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-quobyte-410eab3a-8112-49b0-af6a-67cf96f2cae0" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[60935d5f-8ba5-4f5c-8958-a33eca91a113]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:00 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 1073741824" returned: 0 in 0.644s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:00 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 Jul 18 05:46:00 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:00 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 Jul 18 05:46:00 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:00 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057" returned: 0 in 0.327s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16895109-ee66-48fb-81c2-e2cc358a7b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba30e12f-9acc-4256-a280-9bc168419000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:00 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0" returned: 0 in 0.547s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:00 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Volume volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 (e38d5cd6-379d-48a0-957d-0a82e6cc4057): created successfully Jul 18 05:46:00 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0 Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba30e12f-9acc-4256-a280-9bc168419000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:00 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Flow 'volume_create_manager' (83822df7-d7e7-471a-842c-4ee0746a09a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:00 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-02345caa-9484-4c5d-a7e2-0a25b55b0761 tempest-GroupsTest-1760537783 None] Created volume successfully. Jul 18 05:46:01 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-410eab3a-8112-49b0-af6a-67cf96f2cae0" returned: 0 in 0.351s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-quobyte-410eab3a-8112-49b0-af6a-67cf96f2cae0" released by "delete_volume" :: held 0.974s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Created reservations ['fba54bc8-fae1-47cc-bfa3-1fc5ecfdca49', '99b4b50f-1679-4f58-9715-a5088d457603', 'fd8fc4c5-32a8-48d6-b7e0-e8b911d37c8f', 'ec5071b2-ecfc-4188-91f4-4f149ad00a5a'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:01 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:01 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:01 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.366s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:01 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Deleted volume successfully. Jul 18 05:46:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-208cac99-2a02-4796-ab0a-cd1a1fde85c4 tempest-SnapshotMetadataTestJSON-1305281402 None] Lock "cinder-410eab3a-8112-49b0-af6a-67cf96f2cae0-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Flow 'volume_create_manager' (0eecd2c7-f0ed-46ac-854f-a60c0d1c9cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aae2f35-8136-4a4c-a77b-fc74d29ac3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aae2f35-8136-4a4c-a77b-fc74d29ac3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1055400217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6f68363-4dad-452e-9950-3e2b93a80e68,host='devstack@QuobyteHD#QuobyteHD',id=1493501d-ecf1-4fe8-8235-75e9afeeb055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84c9828609c46e3a9f0a0530ecbb3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:03Z,use_quota=True,user_id='7c680cf7438147d4a00b5d8040b62e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd574d42-1641-4c87-b839-7de1e40d2a68),volume_type_id=fd574d42-1641-4c87-b839-7de1e40d2a68)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05348a48-714b-4ba6-8f72-ba021cf93293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05348a48-714b-4ba6-8f72-ba021cf93293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598e5caa-4ce6-45e4-ae1f-e1e1b46dfd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598e5caa-4ce6-45e4-ae1f-e1e1b46dfd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1493501d-ecf1-4fe8-8235-75e9afeeb055', 'volume_name': 'volume-1493501d-ecf1-4fe8-8235-75e9afeeb055', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d32ece-a13b-4e75-b051-58540ac167b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d32ece-a13b-4e75-b051-58540ac167b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcdce7f-35ad-424f-88b3-4d860faa2d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:02 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Volume 1493501d-ecf1-4fe8-8235-75e9afeeb055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1493501d-ecf1-4fe8-8235-75e9afeeb055', 'volume_size': 1} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6f68363-4dad-452e-9950-3e2b93a80e68,created_at=2026-07-18T03:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1055400217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6f68363-4dad-452e-9950-3e2b93a80e68,host='devstack@QuobyteHD#QuobyteHD',id=1493501d-ecf1-4fe8-8235-75e9afeeb055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84c9828609c46e3a9f0a0530ecbb3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:03Z,use_quota=True,user_id='7c680cf7438147d4a00b5d8040b62e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd574d42-1641-4c87-b839-7de1e40d2a68),volume_type_id=fd574d42-1641-4c87-b839-7de1e40d2a68)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Creating volume 1493501d-ecf1-4fe8-8235-75e9afeeb055 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:02 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:03 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 1073741824 Jul 18 05:46:03 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:03 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 1073741824" returned: 0 in 0.630s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:03 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 Jul 18 05:46:03 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:04 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055" returned: 0 in 0.414s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcdce7f-35ad-424f-88b3-4d860faa2d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1493501d-ecf1-4fe8-8235-75e9afeeb055', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b840a4ce-bda1-4f8a-b9da-78d7e2b40c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:04 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Volume volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 (1493501d-ecf1-4fe8-8235-75e9afeeb055): created successfully Jul 18 05:46:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b840a4ce-bda1-4f8a-b9da-78d7e2b40c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Flow 'volume_create_manager' (0eecd2c7-f0ed-46ac-854f-a60c0d1c9cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:04 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1c924346-514f-4b6e-b5c7-835a7f265b23 tempest-GroupsTest-1760537783 None] Created volume successfully. Jul 18 05:46:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e203f685-a92a-4edf-a9b7-d33d3519d6a4 tempest-GroupsTest-1760537783 None] Update group completed successfully. Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:06 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:06 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:06 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.339s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:46:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:46:06 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6b186682-b015-4e0a-bbfa-9caa1a5f8106 tempest-GroupsTest-1760537783 None] Update group completed successfully. Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Flow 'volume_create_manager' (6f9fd27d-5797-45dc-bd8d-9c687478be6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f760ff-c81b-4f22-a454-4f5297e03b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f760ff-c81b-4f22-a454-4f5297e03b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1532104253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed32213-79f0-431d-901d-157aeb3ccf9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a49eb61772b40319244e1b6e3ab66d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:09Z,use_quota=True,user_id='6ae4f0d2e52c4080a8491f5096ee3a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6b3f59-1fd6-4f5f-b284-7c8144f59937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6b3f59-1fd6-4f5f-b284-7c8144f59937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31365423-3fe5-4be8-8352-b819832ad72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31365423-3fe5-4be8-8352-b819832ad72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed32213-79f0-431d-901d-157aeb3ccf9b', 'volume_name': 'volume-0ed32213-79f0-431d-901d-157aeb3ccf9b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e7ece5-b9b8-415f-8c4b-15700a1643b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e7ece5-b9b8-415f-8c4b-15700a1643b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e0aad3-8c75-481a-bb1b-0066c59b03ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:08 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Volume 0ed32213-79f0-431d-901d-157aeb3ccf9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed32213-79f0-431d-901d-157aeb3ccf9b', 'volume_size': 1} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1532104253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed32213-79f0-431d-901d-157aeb3ccf9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a49eb61772b40319244e1b6e3ab66d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:09Z,use_quota=True,user_id='6ae4f0d2e52c4080a8491f5096ee3a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Creating volume 0ed32213-79f0-431d-901d-157aeb3ccf9b {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:08 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:08 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b 1073741824 Jul 18 05:46:08 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Acquiring lock "cinder-quobyte-1493501d-ecf1-4fe8-8235-75e9afeeb055" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Lock "cinder-quobyte-1493501d-ecf1-4fe8-8235-75e9afeeb055" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3a59d6-94de-4853-b655-3ffd1ae56f04]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:09 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 Jul 18 05:46:09 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:09 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b 1073741824" returned: 0 in 0.720s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:09 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b Jul 18 05:46:09 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:09 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055" returned: 0 in 0.520s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:09 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055 Jul 18 05:46:09 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:09 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b" returned: 0 in 0.266s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e0aad3-8c75-481a-bb1b-0066c59b03ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed32213-79f0-431d-901d-157aeb3ccf9b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1df965f-7478-4327-81ee-3a088acb0766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:09 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Volume volume-0ed32213-79f0-431d-901d-157aeb3ccf9b (0ed32213-79f0-431d-901d-157aeb3ccf9b): created successfully Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1df965f-7478-4327-81ee-3a088acb0766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Flow 'volume_create_manager' (6f9fd27d-5797-45dc-bd8d-9c687478be6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:09 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-358c7684-6977-41da-bb3e-c36815600c99 tempest-VolumesTransfersV357Test-1799353560 None] Created volume successfully. Jul 18 05:46:09 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1493501d-ecf1-4fe8-8235-75e9afeeb055" returned: 0 in 0.259s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Lock "cinder-quobyte-1493501d-ecf1-4fe8-8235-75e9afeeb055" released by "delete_volume" :: held 0.837s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Acquiring lock "cinder-quobyte-e38d5cd6-379d-48a0-957d-0a82e6cc4057" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Lock "cinder-quobyte-e38d5cd6-379d-48a0-957d-0a82e6cc4057" acquired by "delete_volume" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:10 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[592e4115-e09d-4d48-a30d-fd124b396c97]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:10 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 Jul 18 05:46:10 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:10 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057" returned: 0 in 0.428s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:10 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057 Jul 18 05:46:10 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:10 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e38d5cd6-379d-48a0-957d-0a82e6cc4057" returned: 0 in 0.336s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Lock "cinder-quobyte-e38d5cd6-379d-48a0-957d-0a82e6cc4057" released by "delete_volume" :: held 0.823s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:10 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Created reservations ['c6d60f08-9667-471e-a068-c74c36404188'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:10 devstack cinder-volume[87497]: WARNING cinder.quota [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-683416715 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-683416715, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:46:10 devstack cinder-volume[87497]: WARNING cinder.quota [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-683416715 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-683416715, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:46:10 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Created reservations ['57bdebdc-5c46-4acf-9ffe-c2eb2c166f84', '6a9e1451-1c00-4c89-922d-5e121d315be0', 'c9aa9ca4-06a2-4865-9620-765da171b489', '508132f6-e2b8-4d24-a7c5-0217c095480a'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:11 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Created reservations ['2848be80-5a08-483b-901e-e7c0960d526a', '3bb9ebdf-8a9c-486d-a356-9b64f2aa6682', '7429ce3c-9f55-4037-8570-602644c07ac3', '1a055ff7-a40e-4c4d-8cc5-48809c534a9b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:11 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:11 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:11 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4bb96eb2-704e-4ea8-ad3e-0c80cd3a76ea tempest-VolumesTransfersV357Test-697549772 None] Transfer volume completed successfully. Jul 18 05:46:11 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.416s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:11 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:11 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f2eb124a-79fd-4249-ba8b-7f18f2691da4 tempest-GroupsTest-1760537783 None] Delete group completed successfully. Jul 18 05:46:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Acquiring lock "cinder-0ed32213-79f0-431d-901d-157aeb3ccf9b-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Lock "cinder-0ed32213-79f0-431d-901d-157aeb3ccf9b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Acquiring lock "cinder-quobyte-0ed32213-79f0-431d-901d-157aeb3ccf9b" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Lock "cinder-quobyte-0ed32213-79f0-431d-901d-157aeb3ccf9b" acquired by "delete_volume" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:12 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4033cf9c-3c91-4ef9-8ea2-6bdaf5409a22]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:12 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b Jul 18 05:46:12 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:13 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b" returned: 0 in 0.450s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:13 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b Jul 18 05:46:13 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:13 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0ed32213-79f0-431d-901d-157aeb3ccf9b" returned: 0 in 0.301s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Lock "cinder-quobyte-0ed32213-79f0-431d-901d-157aeb3ccf9b" released by "delete_volume" :: held 0.801s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Created reservations ['65f7be67-d849-4160-93e5-e034b5a254bf', '6bf519fd-5087-4e07-b097-dc87ed09e956', '411ac8cd-932d-4e64-94d8-a2427f097c96', '1c47f037-80ed-49d1-a199-7f1796b527c1'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:13 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:13 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:14 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.346s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Deleted volume successfully. Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20c3e395-ea6a-4079-a087-3b0fda0341be tempest-VolumesTransfersV357Test-1257588937 None] Lock "cinder-0ed32213-79f0-431d-901d-157aeb3ccf9b-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Flow 'volume_create_manager' (d4b097e2-1da0-4c50-9f76-e2e26e555942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86f0edb-f49e-4968-b74c-44b79b3c9529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86f0edb-f49e-4968-b74c-44b79b3c9529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1548372372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040e9518-bcd4-4aa4-9306-767384e73d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a49eb61772b40319244e1b6e3ab66d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:14Z,use_quota=True,user_id='6ae4f0d2e52c4080a8491f5096ee3a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3765b37a-457d-4fb7-8ea2-5a3bccb49cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3765b37a-457d-4fb7-8ea2-5a3bccb49cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e08546a-07d4-41bb-82cb-43e5e9f0deec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e08546a-07d4-41bb-82cb-43e5e9f0deec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040e9518-bcd4-4aa4-9306-767384e73d3e', 'volume_name': 'volume-040e9518-bcd4-4aa4-9306-767384e73d3e', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb42207-2dfe-407e-82d4-afce955959dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb42207-2dfe-407e-82d4-afce955959dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25874a3d-826c-47e5-8170-aa6948be23e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:14 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Volume 040e9518-bcd4-4aa4-9306-767384e73d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040e9518-bcd4-4aa4-9306-767384e73d3e', 'volume_size': 1} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1548372372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040e9518-bcd4-4aa4-9306-767384e73d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a49eb61772b40319244e1b6e3ab66d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:14Z,use_quota=True,user_id='6ae4f0d2e52c4080a8491f5096ee3a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Creating volume 040e9518-bcd4-4aa4-9306-767384e73d3e {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:14 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:14 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e 1073741824 Jul 18 05:46:14 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:15 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e 1073741824" returned: 0 in 0.613s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:15 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e Jul 18 05:46:15 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:15 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e" returned: 0 in 0.406s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25874a3d-826c-47e5-8170-aa6948be23e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040e9518-bcd4-4aa4-9306-767384e73d3e', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b202518-cfb6-435f-850e-4cbcf9f41389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Volume volume-040e9518-bcd4-4aa4-9306-767384e73d3e (040e9518-bcd4-4aa4-9306-767384e73d3e): created successfully Jul 18 05:46:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b202518-cfb6-435f-850e-4cbcf9f41389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Flow 'volume_create_manager' (d4b097e2-1da0-4c50-9f76-e2e26e555942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:15 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f72e053f-6b73-43ea-b08c-a600721ee6c8 tempest-VolumesTransfersV357Test-1799353560 None] Created volume successfully. Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Flow 'volume_create_manager' (893cfd94-05ec-44ba-8d2f-4838c0b9b489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df1e6cb-8065-4440-86c6-9ae9386366a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df1e6cb-8065-4440-86c6-9ae9386366a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1475952552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08a61c2-d101-41f7-b151-d174b2493295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49820996eaf45dfa8bde61aa3b27945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:16Z,use_quota=True,user_id='f6c96ead172e4ca3ad65bb186c976cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8079425-db18-4316-bc8f-172e7d4b85df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8079425-db18-4316-bc8f-172e7d4b85df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9232ed7-dfea-49f7-99b6-e64b162303ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9232ed7-dfea-49f7-99b6-e64b162303ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08a61c2-d101-41f7-b151-d174b2493295', 'volume_name': 'volume-c08a61c2-d101-41f7-b151-d174b2493295', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ca1b78-6489-40e8-b3ce-2b5feae80bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ca1b78-6489-40e8-b3ce-2b5feae80bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34d8d61-72ce-45cb-a635-2af56e9e61df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Volume c08a61c2-d101-41f7-b151-d174b2493295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08a61c2-d101-41f7-b151-d174b2493295', 'volume_size': 1} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1475952552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08a61c2-d101-41f7-b151-d174b2493295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49820996eaf45dfa8bde61aa3b27945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:16Z,use_quota=True,user_id='f6c96ead172e4ca3ad65bb186c976cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Creating volume c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:16 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:16 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 1073741824 Jul 18 05:46:16 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:16 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 1073741824" returned: 0 in 0.606s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Acquiring lock "cinder-040e9518-bcd4-4aa4-9306-767384e73d3e-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:17 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 Jul 18 05:46:17 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Lock "cinder-040e9518-bcd4-4aa4-9306-767384e73d3e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Acquiring lock "cinder-quobyte-040e9518-bcd4-4aa4-9306-767384e73d3e" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Lock "cinder-quobyte-040e9518-bcd4-4aa4-9306-767384e73d3e" acquired by "delete_volume" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[51935ee5-8d5c-49ad-8ee2-c165b95d405e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:17 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e Jul 18 05:46:17 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:17 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295" returned: 0 in 0.362s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34d8d61-72ce-45cb-a635-2af56e9e61df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08a61c2-d101-41f7-b151-d174b2493295', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f853f2c3-4901-4ef5-9d8c-1af3abd64428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Volume volume-c08a61c2-d101-41f7-b151-d174b2493295 (c08a61c2-d101-41f7-b151-d174b2493295): created successfully Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f853f2c3-4901-4ef5-9d8c-1af3abd64428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Flow 'volume_create_manager' (893cfd94-05ec-44ba-8d2f-4838c0b9b489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:17 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-853fdb42-e704-449d-bffe-7403560f42fe tempest-SnapshotDependencyTests-88808671 None] Created volume successfully. Jul 18 05:46:17 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e" returned: 0 in 0.418s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:17 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e Jul 18 05:46:17 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:17 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-040e9518-bcd4-4aa4-9306-767384e73d3e" returned: 0 in 0.260s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Lock "cinder-quobyte-040e9518-bcd4-4aa4-9306-767384e73d3e" released by "delete_volume" :: held 0.751s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:17 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Created reservations ['2199457f-3d00-452a-99ca-f93904235fc5', '520bbef5-884c-44d3-be34-a46f00002f8a', '120431fd-7307-4d92-96cd-580d5ced0450', '07e1d7ec-2ba2-43f2-a4f4-a6fe358d037b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:18 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:18 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:18 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.310s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Deleted volume successfully. Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7b214763-2da6-4d4c-87e5-0e7e376e2767 tempest-VolumesTransfersV357Test-1257588937 None] Lock "cinder-040e9518-bcd4-4aa4-9306-767384e73d3e-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Creating offline snapshot d2bfd483-701b-4147-a0a4-ccef15c5259c of volume c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001a5f8-d886-4504-a884-3b7aaeea307a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:18 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 Jul 18 05:46:18 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:19 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295" returned: 0 in 0.394s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:19 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c 1G Jul 18 05:46:19 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:19 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c 1G" returned: 0 in 0.508s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08a61c2-d101-41f7-b151-d174b2493295 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:19 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08a61c2-d101-41f7-b151-d174b2493295 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c Jul 18 05:46:19 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:19 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08a61c2-d101-41f7-b151-d174b2493295 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c" returned: 0 in 0.366s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:19 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c is being set with open permissions: ugo+rw Jul 18 05:46:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:19 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c Jul 18 05:46:19 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:20 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c" returned: 0 in 0.261s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:20 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.info Jul 18 05:46:20 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:20 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.info" returned: 0 in 0.349s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:20 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.info is being set with open permissions: ugo+rw Jul 18 05:46:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:20 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.info Jul 18 05:46:20 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:20 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.info" returned: 0 in 0.335s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-733bfd53-53b2-4dcd-945d-88525d3dd034 tempest-SnapshotDependencyTests-88808671 None] Create snapshot completed successfully Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Flow 'volume_create_manager' (ee6c3cd9-66b1-42b6-b7cb-65340976029a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0784ec24-35e7-48c4-a755-04e80bcd8427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0784ec24-35e7-48c4-a755-04e80bcd8427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1557927397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308de490-2a45-467a-bbac-9382da2e59f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='897f4cc45b0848a6af413476a2c183e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:21Z,use_quota=True,user_id='13f531f2f4fd4dff96fccce7fa86e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a05673b-cb93-47bc-a899-956cfd617291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a05673b-cb93-47bc-a899-956cfd617291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacc5d50-b031-405c-b379-3cf0049ec46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacc5d50-b031-405c-b379-3cf0049ec46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308de490-2a45-467a-bbac-9382da2e59f4', 'volume_name': 'volume-308de490-2a45-467a-bbac-9382da2e59f4', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48424b92-0acd-4d67-9e95-383fee410340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48424b92-0acd-4d67-9e95-383fee410340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612296a9-67cd-4ce6-a7fa-0cdf8232e5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Volume 308de490-2a45-467a-bbac-9382da2e59f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308de490-2a45-467a-bbac-9382da2e59f4', 'volume_size': 1} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1557927397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308de490-2a45-467a-bbac-9382da2e59f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='897f4cc45b0848a6af413476a2c183e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:21Z,use_quota=True,user_id='13f531f2f4fd4dff96fccce7fa86e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Creating volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:21 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:21 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 1073741824 Jul 18 05:46:21 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:22 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 1073741824" returned: 0 in 0.550s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:22 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 Jul 18 05:46:22 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:22 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4" returned: 0 in 0.380s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612296a9-67cd-4ce6-a7fa-0cdf8232e5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308de490-2a45-467a-bbac-9382da2e59f4', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f45be9-bf2d-4d95-a7eb-d076228b1fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:22 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Volume volume-308de490-2a45-467a-bbac-9382da2e59f4 (308de490-2a45-467a-bbac-9382da2e59f4): created successfully Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f45be9-bf2d-4d95-a7eb-d076228b1fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Flow 'volume_create_manager' (ee6c3cd9-66b1-42b6-b7cb-65340976029a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-fa9174ff-b575-420a-82c1-81484baa0a50 tempest-SnapshotsActionsTest-471952212 None] Created volume successfully. Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Flow 'volume_create_manager' (7ec9e0b5-1f4d-4a37-b587-56ab4e45202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e49f92e-ea76-4617-a7e6-825321420037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e49f92e-ea76-4617-a7e6-825321420037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fa5c89-7d10-44a0-82cc-b706759d017e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49820996eaf45dfa8bde61aa3b27945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d2bfd483-701b-4147-a0a4-ccef15c5259c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:23Z,use_quota=True,user_id='f6c96ead172e4ca3ad65bb186c976cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6626da5a-feb9-4c21-ab73-a077997c4989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6626da5a-feb9-4c21-ab73-a077997c4989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287ef2d7-7f8a-4047-8501-db33b17cde0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287ef2d7-7f8a-4047-8501-db33b17cde0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47fa5c89-7d10-44a0-82cc-b706759d017e', 'volume_name': 'volume-47fa5c89-7d10-44a0-82cc-b706759d017e', 'volume_size': 1, 'snapshot_id': 'd2bfd483-701b-4147-a0a4-ccef15c5259c'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d266f78c-0a0d-40d9-a2ba-39fd913402f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d266f78c-0a0d-40d9-a2ba-39fd913402f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8540fa-3329-4e7e-97a5-fe392275bfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:22 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Volume 47fa5c89-7d10-44a0-82cc-b706759d017e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47fa5c89-7d10-44a0-82cc-b706759d017e', 'volume_size': 1, 'snapshot_id': 'd2bfd483-701b-4147-a0a4-ccef15c5259c'} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "cinder-quobyte-d2bfd483-701b-4147-a0a4-ccef15c5259c-47fa5c89-7d10-44a0-82cc-b706759d017e" by "_create_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-d2bfd483-701b-4147-a0a4-ccef15c5259c-47fa5c89-7d10-44a0-82cc-b706759d017e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Creating volume 47fa5c89-7d10-44a0-82cc-b706759d017e from snapshot d2bfd483-701b-4147-a0a4-ccef15c5259c {{(pid=87497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "cinder-quobyte-47fa5c89-7d10-44a0-82cc-b706759d017e" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-47fa5c89-7d10-44a0-82cc-b706759d017e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] snapshot: d2bfd483-701b-4147-a0a4-ccef15c5259c, volume: 47fa5c89-7d10-44a0-82cc-b706759d017e, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce0499d-b38a-4192-a6a9-16187e356041]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:23 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c Jul 18 05:46:23 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:23 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c" returned: 0 in 0.384s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c08a61c2-d101-41f7-b151-d174b2493295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[54816d35-ad10-4dd2-91aa-96a5b693630f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:23 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 Jul 18 05:46:23 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:23 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295" returned: 0 in 0.576s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:23 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e Jul 18 05:46:23 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Flow 'volume_create_manager' (abe65806-3760-4e21-b9ba-0b446d6c7a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c0da25-8c01-409a-adc6-b19be420c738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:29 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c0da25-8c01-409a-adc6-b19be420c738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-878775469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5380c53-86fc-4286-b652-4587d0b320f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef6054ef1e9439ebd965a59da71f04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:29Z,use_quota=True,user_id='aece5bf112a4457eabdc1b978bc82c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d304b84e-da0d-4ce2-9fce-fe574553ee0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d304b84e-da0d-4ce2-9fce-fe574553ee0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324b87c7-101e-48c1-8794-a9f31168dfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.image.glance [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Creating Keystone auth plugin from conf {{(pid=87497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e" returned: 0 in 5.441s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e959782-dd7e-4dbf-a8f3-a4e52c836c40]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:29 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 Jul 18 05:46:29 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324b87c7-101e-48c1-8794-a9f31168dfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5380c53-86fc-4286-b652-4587d0b320f8', 'volume_name': 'volume-f5380c53-86fc-4286-b652-4587d0b320f8', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97232d8-1210-4dcd-9aee-0f2cb084f05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97232d8-1210-4dcd-9aee-0f2cb084f05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd9d3f4-9eaf-46f5-9383-215974802c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:29 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Volume f5380c53-86fc-4286-b652-4587d0b320f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5380c53-86fc-4286-b652-4587d0b320f8', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 18 05:46:29 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Trying to clone f5380c53-86fc-4286-b652-4587d0b320f8 from image 0d6393c9-e8a0-4628-b021-8c9aa5777656 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]). {{(pid=87497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 05:46:30 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295" returned: 0 in 0.643s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:46:30 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Converted 1024.00 MB image at 188.16 MB/s Jul 18 05:46:30 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e is being set with open permissions: ugo+rw Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:30 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e Jul 18 05:46:30 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 05:46:30 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Image download 20.69 MB at 20.69 MB/s Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6598e23-7e28-419b-8231-2066343073d6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:30 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD Jul 18 05:46:30 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:30 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e" returned: 0 in 0.351s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-47fa5c89-7d10-44a0-82cc-b706759d017e" released by "_copy_volume_from_snapshot" :: held 7.537s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-d2bfd483-701b-4147-a0a4-ccef15c5259c-47fa5c89-7d10-44a0-82cc-b706759d017e" released by "_create_volume_from_snapshot" :: held 7.584s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.598s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.415s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Creating offline snapshot b0918931-1784-4c51-8781-20c6a980debc of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8540fa-3329-4e7e-97a5-fe392275bfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47fa5c89-7d10-44a0-82cc-b706759d017e', 'volume_size': 1, 'snapshot_id': 'd2bfd483-701b-4147-a0a4-ccef15c5259c'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650af6f0-46b5-40a3-a4b6-edd3716f3328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[77163e0c-69c7-4e0e-a0c2-80183632befe]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:30 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Volume volume-47fa5c89-7d10-44a0-82cc-b706759d017e (47fa5c89-7d10-44a0-82cc-b706759d017e): created successfully Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650af6f0-46b5-40a3-a4b6-edd3716f3328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Flow 'volume_create_manager' (7ec9e0b5-1f4d-4a37-b587-56ab4e45202c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e5f7957b-93f5-43b7-8841-bf9f1df31e51 tempest-SnapshotDependencyTests-88808671 None] Created volume successfully. Jul 18 05:46:30 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 Jul 18 05:46:30 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:30 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Temporary image 0d6393c9-e8a0-4628-b021-8c9aa5777656 is fetched for user aece5bf112a4457eabdc1b978bc82c80. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcec0e2-d2a4-42ed-868b-83cf64e7a8c9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:30 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD Jul 18 05:46:30 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:30 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4" returned: 0 in 0.456s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:30 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc 1G Jul 18 05:46:30 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:31 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:31 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc 1G" returned: 0 in 0.435s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:31 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:31 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:31 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.350s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:31 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc is being set with open permissions: ugo+rw Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "cinder-d2bfd483-701b-4147-a0a4-ccef15c5259c-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:31 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:31 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-d2bfd483-701b-4147-a0a4-ccef15c5259c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "cinder-quobyte-c08a61c2-d101-41f7-b151-d174b2493295" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-c08a61c2-d101-41f7-b151-d174b2493295" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "cinder-quobyte-d2bfd483-701b-4147-a0a4-ccef15c5259c" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-d2bfd483-701b-4147-a0a4-ccef15c5259c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Deleting offline snapshot d2bfd483-701b-4147-a0a4-ccef15c5259c of volume c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] snapshot_file for this snap is: volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ddf32-5f1e-4eec-80ac-d6e4615416ff]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:31 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c Jul 18 05:46:31 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:31 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.277s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:32 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.info Jul 18 05:46:32 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:32 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c" returned: 0 in 0.401s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c08a61c2-d101-41f7-b151-d174b2493295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ad338b-ddd3-4e3e-baa3-c7cf4076150f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:32 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.info" returned: 0 in 0.285s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:32 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.info is being set with open permissions: ugo+rw Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:32 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.info Jul 18 05:46:32 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:32 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 Jul 18 05:46:32 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:32 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.info" returned: 0 in 0.283s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.531s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-878775469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5380c53-86fc-4286-b652-4587d0b320f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef6054ef1e9439ebd965a59da71f04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:29Z,use_quota=True,user_id='aece5bf112a4457eabdc1b978bc82c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Creating volume f5380c53-86fc-4286-b652-4587d0b320f8 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:32 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:32 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 1073741824 Jul 18 05:46:32 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-015e9c26-50d4-4907-801d-e0b24e52d43d tempest-SnapshotsActionsTest-471952212 None] Create snapshot completed successfully Jul 18 05:46:32 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295" returned: 0 in 0.414s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:32 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c Jul 18 05:46:32 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:33 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c" returned: 0 in 0.382s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:33 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 1073741824" returned: 0 in 0.457s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:33 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c Jul 18 05:46:33 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:33 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 Jul 18 05:46:33 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:33 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295.d2bfd483-701b-4147-a0a4-ccef15c5259c" returned: 0 in 0.250s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-d2bfd483-701b-4147-a0a4-ccef15c5259c" released by "_delete_snapshot" :: held 1.581s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-c08a61c2-d101-41f7-b151-d174b2493295" released by "delete_snapshot" :: held 1.604s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:33 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8" returned: 0 in 0.274s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Attempting download of 0d6393c9-e8a0-4628-b021-8c9aa5777656 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}])) to volume f5380c53-86fc-4286-b652-4587d0b320f8. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Created reservations ['8a3bdb24-b7bc-4a77-ad22-ffdb5557a255', 'f85a6510-8c95-4b70-88be-757bf0bdf07a', 'ccc37f50-b1f5-4a76-b6c0-8359ae12a7f2', 'b37d9b92-aa92-4c7d-9dd5-56f2f22b734c'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d86a24-348c-40ae-b2e8-036acd52e059]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_sezakm66 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Delete snapshot completed successfully. Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-46902eea-c5a6-407c-9035-5158dfba0ea6 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-d2bfd483-701b-4147-a0a4-ccef15c5259c-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:33 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_sezakm66 Jul 18 05:46:33 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:33 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_sezakm66" returned: 0 in 0.389s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_sezakm66 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:34 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_sezakm66 Jul 18 05:46:34 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "cinder-c08a61c2-d101-41f7-b151-d174b2493295-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-c08a61c2-d101-41f7-b151-d174b2493295-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "cinder-quobyte-c08a61c2-d101-41f7-b151-d174b2493295" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-c08a61c2-d101-41f7-b151-d174b2493295" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[835f4cc5-99bd-4910-bd98-1fe02837a28b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:34 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_sezakm66" returned: 1 in 0.442s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_sezakm66' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8136a8-1816-4f99-a636-2ff6f5b215ed]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:34 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 Jul 18 05:46:34 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:34 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD Jul 18 05:46:34 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Flow 'volume_create_manager' (d70db9be-abbb-4cc3-91ca-eac3f58a9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dee5a6e-19be-4499-85aa-49d34e1bff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dee5a6e-19be-4499-85aa-49d34e1bff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-95593796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b126e946-5604-41a4-af14-0f327c4777ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8727fbea124de3b9be1dbcfc215125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:34Z,use_quota=True,user_id='f405724293b84b5d8e366064198e5059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(202bcbac-d4db-4af8-bda5-70b16c28dc8f),volume_type_id=202bcbac-d4db-4af8-bda5-70b16c28dc8f)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f887dd-d639-4d6a-9420-9c14446b340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f887dd-d639-4d6a-9420-9c14446b340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:34 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf250e3-f1e0-4ecc-aca9-b92bdf797552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf250e3-f1e0-4ecc-aca9-b92bdf797552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b126e946-5604-41a4-af14-0f327c4777ac', 'volume_name': 'volume-b126e946-5604-41a4-af14-0f327c4777ac', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b29be3d-c86f-41d3-85a9-82db32482bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b29be3d-c86f-41d3-85a9-82db32482bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7a9e61-492c-4580-b261-4476bfff3e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:34 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Volume b126e946-5604-41a4-af14-0f327c4777ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b126e946-5604-41a4-af14-0f327c4777ac', 'volume_size': 1} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-95593796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b126e946-5604-41a4-af14-0f327c4777ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8727fbea124de3b9be1dbcfc215125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:34Z,use_quota=True,user_id='f405724293b84b5d8e366064198e5059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(202bcbac-d4db-4af8-bda5-70b16c28dc8f),volume_type_id=202bcbac-d4db-4af8-bda5-70b16c28dc8f)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Creating volume b126e946-5604-41a4-af14-0f327c4777ac {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:34 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295" returned: 0 in 0.496s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:34 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac 1073741824 Jul 18 05:46:34 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:34 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295 Jul 18 05:46:34 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:34 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] 0d6393c9-e8a0-4628-b021-8c9aa5777656 was qcow2, converting to qcow2 {{(pid=87497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:34 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 Jul 18 05:46:34 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:34 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c08a61c2-d101-41f7-b151-d174b2493295" returned: 0 in 0.267s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-c08a61c2-d101-41f7-b151-d174b2493295" released by "delete_volume" :: held 0.854s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Created reservations ['bbe23d0e-98b4-492e-a933-ec183fb891da', '2ea1bb5a-8156-4317-8fec-82b41bf19090', '5218b327-23a3-417c-8cff-0b2f945be804', '00824690-4e72-4c07-839b-ee6a1d486de8'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:35 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:35 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:35 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac 1073741824" returned: 0 in 0.483s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:35 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac Jul 18 05:46:35 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "cinder-47fa5c89-7d10-44a0-82cc-b706759d017e-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-47fa5c89-7d10-44a0-82cc-b706759d017e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "cinder-quobyte-47fa5c89-7d10-44a0-82cc-b706759d017e" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-47fa5c89-7d10-44a0-82cc-b706759d017e" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a438e-0c8d-448f-a061-b274b728ca01]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:35 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.374s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Deleted volume successfully. Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1226d737-1c7f-4d72-a937-8fb9021bf1e8 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-c08a61c2-d101-41f7-b151-d174b2493295-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:35 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac" returned: 0 in 0.380s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.856s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7a9e61-492c-4580-b261-4476bfff3e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b126e946-5604-41a4-af14-0f327c4777ac', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7f62dc-6482-475e-911e-a6982a29cf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Creating offline snapshot 5890d6a7-a50b-4c8e-bc80-dd636d597ee6 of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:46:35 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e Jul 18 05:46:35 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:35 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Volume volume-b126e946-5604-41a4-af14-0f327c4777ac (b126e946-5604-41a4-af14-0f327c4777ac): created successfully Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7f62dc-6482-475e-911e-a6982a29cf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Flow 'volume_create_manager' (d70db9be-abbb-4cc3-91ca-eac3f58a9eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c142a-bc51-4e43-9f1b-c33e01c15ca9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8a5ef0a4-7580-4a68-91aa-22ea128c33d5 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Created volume successfully. Jul 18 05:46:35 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:35 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:35 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e" returned: 0 in 0.470s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:35 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e Jul 18 05:46:36 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:36 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.436s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:36 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 1G Jul 18 05:46:36 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:36 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47fa5c89-7d10-44a0-82cc-b706759d017e" returned: 0 in 0.345s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-quobyte-47fa5c89-7d10-44a0-82cc-b706759d017e" released by "delete_volume" :: held 0.876s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Created reservations ['df78354a-f227-4b3d-b357-13edabf9be04', 'cb0a4ef0-5dbc-456d-97c9-5dd3215f29ba', 'bda18f3b-8ed7-4a84-92ac-c22a5b5f9072', 'f8ba4479-8e2c-45bb-ab57-09f45f528040'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:36 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:36 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:36 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 1G" returned: 0 in 0.644s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:36 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 Jul 18 05:46:36 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:36 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.389s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:36 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Deleted volume successfully. Jul 18 05:46:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5e79d8d8-4068-459f-83b0-d6a2ca6f1f41 tempest-SnapshotDependencyTests-88808671 None] Lock "cinder-47fa5c89-7d10-44a0-82cc-b706759d017e-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:37 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8" returned: 0 in 2.217s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_l9e_yl0tdevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:46:37 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Converted 112.00 MB image at 50.50 MB/s Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:37 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 1G Jul 18 05:46:37 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-33ef7060-e3e7-43fb-a5be-fa0cfe4677a6 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-33ef7060-e3e7-43fb-a5be-fa0cfe4677a6 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-33ef7060-e3e7-43fb-a5be-fa0cfe4677a6 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-33ef7060-e3e7-43fb-a5be-fa0cfe4677a6 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-33ef7060-e3e7-43fb-a5be-fa0cfe4677a6 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33ef7060-e3e7-43fb-a5be-fa0cfe4677a6 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:37 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:37 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:37 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6" returned: 0 in 0.438s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:37 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 is being set with open permissions: ugo+rw Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:37 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 Jul 18 05:46:37 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:37 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 1G" returned: 0 in 0.385s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Downloaded image 0d6393c9-e8a0-4628-b021-8c9aa5777656 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}])) to volume f5380c53-86fc-4286-b652-4587d0b320f8 successfully. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Temporary image 0d6393c9-e8a0-4628-b021-8c9aa5777656 for user aece5bf112a4457eabdc1b978bc82c80 is deleted. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Marking volume f5380c53-86fc-4286-b652-4587d0b320f8 as bootable. {{(pid=87497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Copying metadata from image 0d6393c9-e8a0-4628-b021-8c9aa5777656 to f5380c53-86fc-4286-b652-4587d0b320f8. {{(pid=87497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Creating volume glance metadata for volume f5380c53-86fc-4286-b652-4587d0b320f8 backed by image 0d6393c9-e8a0-4628-b021-8c9aa5777656 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 05:46:37 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33ef7060-e3e7-43fb-a5be-fa0cfe4677a6 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.295s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-33ef7060-e3e7-43fb-a5be-fa0cfe4677a6 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-33ef7060-e3e7-43fb-a5be-fa0cfe4677a6 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Retype volume completed successfully. Jul 18 05:46:37 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd9d3f4-9eaf-46f5-9383-215974802c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5380c53-86fc-4286-b652-4587d0b320f8', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa42fed-1d4e-4cd1-8da5-fe7baffa9c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6" returned: 0 in 0.368s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:37 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Volume volume-f5380c53-86fc-4286-b652-4587d0b320f8 (f5380c53-86fc-4286-b652-4587d0b320f8): created successfully Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa42fed-1d4e-4cd1-8da5-fe7baffa9c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Flow 'volume_create_manager' (abe65806-3760-4e21-b9ba-0b446d6c7a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c6d57627-1975-4eda-859e-4f8c650ead8b tempest-VolumesExtendTest-1912949289 None] Created volume successfully. Jul 18 05:46:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4aaa23c9-6832-49fc-8911-d7135c286c0f tempest-SnapshotsActionsTest-471952212 None] Create snapshot completed successfully Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-5890d6a7-a50b-4c8e-bc80-dd636d597ee6-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-5890d6a7-a50b-4c8e-bc80-dd636d597ee6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-quobyte-5890d6a7-a50b-4c8e-bc80-dd636d597ee6" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e3a0ab4c-611d-4aec-907a-85679394eb65 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e3a0ab4c-611d-4aec-907a-85679394eb65 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-5890d6a7-a50b-4c8e-bc80-dd636d597ee6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Deleting offline snapshot 5890d6a7-a50b-4c8e-bc80-dd636d597ee6 of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] snapshot_file for this snap is: volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[81750726-a327-4fd5-a8e3-cf7edab1450b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3a0ab4c-611d-4aec-907a-85679394eb65 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7de0b16-6544-40a2-97ca-4870c6c3df57]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:38 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 Jul 18 05:46:38 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:38 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 Jul 18 05:46:38 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Acquiring lock "cinder-b126e946-5604-41a4-af14-0f327c4777ac-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "cinder-b126e946-5604-41a4-af14-0f327c4777ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:38 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3a0ab4c-611d-4aec-907a-85679394eb65 tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8" returned: 0 in 0.522s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3a0ab4c-611d-4aec-907a-85679394eb65 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 2G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:38 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6" returned: 0 in 0.538s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd476931-ed17-4fd8-a62e-18a3caf457c0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Acquiring lock "cinder-quobyte-b126e946-5604-41a4-af14-0f327c4777ac" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "cinder-quobyte-b126e946-5604-41a4-af14-0f327c4777ac" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[968004b5-4e4f-4a3d-88b6-a3f4f247da8a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e3a0ab4c-611d-4aec-907a-85679394eb65 tempest-VolumesExtendTest-1912949289 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 2G" returned: 0 in 0.132s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e3a0ab4c-611d-4aec-907a-85679394eb65 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.712s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:38 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e3a0ab4c-611d-4aec-907a-85679394eb65 tempest-VolumesExtendTest-1912949289 None] Extend volume completed successfully. Jul 18 05:46:38 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:38 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:38 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac Jul 18 05:46:38 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:39 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.411s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:39 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 Jul 18 05:46:39 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:39 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac" returned: 0 in 0.466s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:39 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac Jul 18 05:46:39 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "cinder-f5380c53-86fc-4286-b652-4587d0b320f8-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Lock "cinder-f5380c53-86fc-4286-b652-4587d0b320f8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "cinder-quobyte-f5380c53-86fc-4286-b652-4587d0b320f8" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Lock "cinder-quobyte-f5380c53-86fc-4286-b652-4587d0b320f8" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1843ea-e7b8-43f3-9791-adc73d70f18c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:39 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b126e946-5604-41a4-af14-0f327c4777ac" returned: 0 in 0.367s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "cinder-quobyte-b126e946-5604-41a4-af14-0f327c4777ac" released by "delete_volume" :: held 0.891s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:39 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6" returned: 0 in 0.536s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:39 devstack cinder-volume[87497]: WARNING cinder.quota [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:46:39 devstack cinder-volume[87497]: WARNING cinder.quota [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:46:39 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6 Jul 18 05:46:39 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:39 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 Jul 18 05:46:39 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Created reservations ['d2a116b5-6844-44f1-a529-865178ecd690', 'd495f115-b989-4ec4-bad0-28c743033003', 'ed4ccb81-4475-45e5-a697-b8daea67001c', '28e00644-0bbf-4096-9ad5-885e02aa0254'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:39 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:39 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:39 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8" returned: 0 in 0.455s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:40 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8 Jul 18 05:46:40 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:40 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.5890d6a7-a50b-4c8e-bc80-dd636d597ee6" returned: 0 in 0.513s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-5890d6a7-a50b-4c8e-bc80-dd636d597ee6" released by "_delete_snapshot" :: held 2.115s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" released by "delete_snapshot" :: held 2.153s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:40 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Deleted volume successfully. Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3ef9ab88-7089-4c29-b191-6690b96d6a41 tempest-VolumeRetypeWithoutMigrationTest-1972467916 None] Lock "cinder-b126e946-5604-41a4-af14-0f327c4777ac-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Created reservations ['7e55b010-8de6-4af1-9a79-b473457a135e', 'f03db3dd-9e2e-4480-b18c-3d6a9de914b8', '36dcd277-e94c-4357-8cec-44eee07a4a2c', 'cd7c00a7-d5e4-4fbe-8f44-c7027840e49c'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Delete snapshot completed successfully. Jul 18 05:46:40 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f277f519-7325-4c90-a8ae-8ff08b2fbda3 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-5890d6a7-a50b-4c8e-bc80-dd636d597ee6-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5380c53-86fc-4286-b652-4587d0b320f8" returned: 0 in 0.328s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Lock "cinder-quobyte-f5380c53-86fc-4286-b652-4587d0b320f8" released by "delete_volume" :: held 0.823s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Created reservations ['8e4c455b-0e6e-46b0-bb46-ccff986cbfd9', '82388449-f9c6-4b8e-b99f-8497f3942257', '2424cdfc-1b78-45eb-9317-dfbbc0531929', '9a9916ab-d83e-43dc-9f3d-f6e8dd18ad18'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:40 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:40 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:40 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.304s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Deleted volume successfully. Jul 18 05:46:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0d305d05-880a-4770-922b-65cc0dc08c81 tempest-VolumesExtendTest-1912949289 None] Lock "cinder-f5380c53-86fc-4286-b652-4587d0b320f8-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Flow 'volume_create_manager' (76ee9943-eba9-49c0-87f5-63a0bc574ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b92b05a9-bd5b-4563-9160-1ce1a3517117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b92b05a9-bd5b-4563-9160-1ce1a3517117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-582392247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b159159-f5fa-4e22-88d9-b8088cab4801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef6054ef1e9439ebd965a59da71f04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:41Z,use_quota=True,user_id='aece5bf112a4457eabdc1b978bc82c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b44c13-f367-4a03-a9f4-54e6328bc7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b44c13-f367-4a03-a9f4-54e6328bc7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1263e6-1418-43a6-9268-dfbc8f6785b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1263e6-1418-43a6-9268-dfbc8f6785b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b159159-f5fa-4e22-88d9-b8088cab4801', 'volume_name': 'volume-2b159159-f5fa-4e22-88d9-b8088cab4801', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516af48d-9d96-4ba8-97f3-1030c6553065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516af48d-9d96-4ba8-97f3-1030c6553065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82305a1c-4a9e-4e81-bea3-d2f01f485498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:41 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Volume 2b159159-f5fa-4e22-88d9-b8088cab4801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b159159-f5fa-4e22-88d9-b8088cab4801', 'volume_size': 1} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-582392247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b159159-f5fa-4e22-88d9-b8088cab4801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef6054ef1e9439ebd965a59da71f04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:41Z,use_quota=True,user_id='aece5bf112a4457eabdc1b978bc82c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Creating volume 2b159159-f5fa-4e22-88d9-b8088cab4801 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:41 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:41 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 1073741824 Jul 18 05:46:41 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:41 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 1073741824" returned: 0 in 0.558s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:41 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 Jul 18 05:46:41 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:42 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801" returned: 0 in 0.278s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.661s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82305a1c-4a9e-4e81-bea3-d2f01f485498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b159159-f5fa-4e22-88d9-b8088cab4801', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de938a74-e882-4f62-b1bd-9b30e4982ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Creating offline snapshot d291119f-5719-4c7e-b6c9-84e670d989d5 of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:46:42 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Volume volume-2b159159-f5fa-4e22-88d9-b8088cab4801 (2b159159-f5fa-4e22-88d9-b8088cab4801): created successfully Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de938a74-e882-4f62-b1bd-9b30e4982ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Flow 'volume_create_manager' (76ee9943-eba9-49c0-87f5-63a0bc574ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c21664-b43c-412b-9034-ab982e5347bc]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f3d21be2-f351-4bf8-9e71-5320717e8776 tempest-VolumesExtendTest-1912949289 None] Created volume successfully. Jul 18 05:46:42 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:42 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:42 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.441s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:42 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 1G Jul 18 05:46:42 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:43 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 1G" returned: 0 in 0.607s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:43 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 Jul 18 05:46:43 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:43 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5" returned: 0 in 0.406s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:43 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 is being set with open permissions: ugo+rw Jul 18 05:46:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:43 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 Jul 18 05:46:43 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:44 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5" returned: 0 in 0.274s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.623s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Creating offline snapshot 6b0aa725-e2eb-4287-8851-d9c36ef3bf41 of volume 2b159159-f5fa-4e22-88d9-b8088cab4801 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:46:44 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d6c11b3f-5b59-434b-abe8-ed0cd406bcaf tempest-SnapshotsActionsTest-471952212 None] Create snapshot completed successfully Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[244747b9-cd1d-4b9b-997d-7e8b0b753261]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:44 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 Jul 18 05:46:44 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:44 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801" returned: 0 in 0.398s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:44 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 1G Jul 18 05:46:44 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-d291119f-5719-4c7e-b6c9-84e670d989d5-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-d291119f-5719-4c7e-b6c9-84e670d989d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-quobyte-d291119f-5719-4c7e-b6c9-84e670d989d5" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-d291119f-5719-4c7e-b6c9-84e670d989d5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Deleting offline snapshot d291119f-5719-4c7e-b6c9-84e670d989d5 of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] snapshot_file for this snap is: volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2745c05-55cc-403a-a826-339283e0fb6b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:45 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 1G" returned: 0 in 0.598s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b159159-f5fa-4e22-88d9-b8088cab4801 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:45 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 Jul 18 05:46:45 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:45 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b159159-f5fa-4e22-88d9-b8088cab4801 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 Jul 18 05:46:45 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:45 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b159159-f5fa-4e22-88d9-b8088cab4801 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41" returned: 0 in 0.355s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:45 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 is being set with open permissions: ugo+rw Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:45 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5" returned: 0 in 0.494s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:45 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 Jul 18 05:46:45 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d63169-ce15-4d3f-ba4f-4ad4b11604b7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:45 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:45 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:45 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41" returned: 0 in 0.376s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:46 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.info Jul 18 05:46:46 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:46 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.544s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:46 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 Jul 18 05:46:46 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:46 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.info" returned: 0 in 0.335s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:46 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.info is being set with open permissions: ugo+rw Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:46 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.info Jul 18 05:46:46 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:46 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.info" returned: 0 in 0.317s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:46 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5" returned: 0 in 0.521s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:46 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5 Jul 18 05:46:46 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-57c09d06-3a9c-452b-b78f-650c40949055 tempest-VolumesExtendTest-1912949289 None] Create snapshot completed successfully Jul 18 05:46:46 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.d291119f-5719-4c7e-b6c9-84e670d989d5" returned: 0 in 0.284s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-d291119f-5719-4c7e-b6c9-84e670d989d5" released by "_delete_snapshot" :: held 1.976s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" released by "delete_snapshot" :: held 2.006s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:47 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Created reservations ['ca32b398-dbfc-46a9-bf06-b33e862b0d53', 'f7576b6a-500f-49f6-bb3c-832023b29069', '4ce007a6-d6ef-4a60-8a30-999d4ebe3c40', '9864d0a8-efec-4bee-a9f0-14538d3bc01d'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Delete snapshot completed successfully. Jul 18 05:46:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ab7f40e2-31a3-4e2c-ad59-f5ca10a593ed tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-d291119f-5719-4c7e-b6c9-84e670d989d5-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-11a0e189-77f5-4393-b56a-3bd9cd2e8e05 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-11a0e189-77f5-4393-b56a-3bd9cd2e8e05 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:47 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[008443a6-889e-4f35-b34b-e9582e9fc014]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-11a0e189-77f5-4393-b56a-3bd9cd2e8e05 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:47 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 Jul 18 05:46:47 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:48 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-11a0e189-77f5-4393-b56a-3bd9cd2e8e05 tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801" returned: 0 in 0.383s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-11a0e189-77f5-4393-b56a-3bd9cd2e8e05 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 2G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-11a0e189-77f5-4393-b56a-3bd9cd2e8e05 tempest-VolumesExtendTest-1912949289 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 2G" returned: 0 in 0.170s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-11a0e189-77f5-4393-b56a-3bd9cd2e8e05 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.586s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:48 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-11a0e189-77f5-4393-b56a-3bd9cd2e8e05 tempest-VolumesExtendTest-1912949289 None] Extend volume completed successfully. Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Creating offline snapshot 1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dd6367-c421-46e2-aa1e-b3f018b55d37]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:48 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:48 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:48 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.386s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:49 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 1G Jul 18 05:46:49 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Acquiring lock "cinder-6b0aa725-e2eb-4287-8851-d9c36ef3bf41-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Lock "cinder-6b0aa725-e2eb-4287-8851-d9c36ef3bf41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Acquiring lock "cinder-quobyte-2b159159-f5fa-4e22-88d9-b8088cab4801" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Lock "cinder-quobyte-2b159159-f5fa-4e22-88d9-b8088cab4801" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Acquiring lock "cinder-quobyte-6b0aa725-e2eb-4287-8851-d9c36ef3bf41" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Lock "cinder-quobyte-6b0aa725-e2eb-4287-8851-d9c36ef3bf41" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Deleting offline snapshot 6b0aa725-e2eb-4287-8851-d9c36ef3bf41 of volume 2b159159-f5fa-4e22-88d9-b8088cab4801 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] snapshot_file for this snap is: volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba66f58c-b481-436e-84ba-f78866e96377]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:49 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 Jul 18 05:46:49 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:49 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 1G" returned: 0 in 0.506s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:49 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 Jul 18 05:46:49 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:49 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41" returned: 0 in 0.418s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b159159-f5fa-4e22-88d9-b8088cab4801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f607a70-5d25-4c9f-b2ed-f8139dc478d9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:49 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 Jul 18 05:46:49 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:49 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138" returned: 0 in 0.339s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:49 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 is being set with open permissions: ugo+rw Jul 18 05:46:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:49 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 Jul 18 05:46:49 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:50 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801" returned: 0 in 0.463s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:50 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138" returned: 0 in 0.290s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:50 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 Jul 18 05:46:50 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.627s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=191,cinder:SELECT=174,cinder:DELETE=9,cinder:INSERT=41 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:46:50 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-16ee6533-0661-4e58-afc0-2f38120666a1 tempest-SnapshotsActionsTest-471952212 None] Create snapshot completed successfully Jul 18 05:46:50 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41" returned: 0 in 0.393s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:50 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41 Jul 18 05:46:50 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:50 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801.6b0aa725-e2eb-4287-8851-d9c36ef3bf41" returned: 0 in 0.260s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Lock "cinder-quobyte-6b0aa725-e2eb-4287-8851-d9c36ef3bf41" released by "_delete_snapshot" :: held 1.702s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Lock "cinder-quobyte-2b159159-f5fa-4e22-88d9-b8088cab4801" released by "delete_snapshot" :: held 1.730s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-quobyte-1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Deleting offline snapshot 1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] snapshot_file for this snap is: volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a782e25c-d7fc-462b-b7f1-049b8bc5e0e0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:50 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Created reservations ['de71b192-bf03-4a0a-b1f2-8e4b3206911b', '70c55678-24c9-411e-9e72-f090603243cc', '4df4a222-94a5-42d4-b119-87fb4f6d6299', '363f6259-cf63-4740-a065-720810fd8f56'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:51 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Delete snapshot completed successfully. Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3d37786-249a-4d67-9e04-9750e2a1638d tempest-VolumesExtendTest-1912949289 None] Lock "cinder-6b0aa725-e2eb-4287-8851-d9c36ef3bf41-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:51 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 Jul 18 05:46:51 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:51 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "cinder-2b159159-f5fa-4e22-88d9-b8088cab4801-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138" returned: 0 in 0.415s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Lock "cinder-2b159159-f5fa-4e22-88d9-b8088cab4801-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af060b9-e2ea-4bff-8ca0-781e5220a8e7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "cinder-quobyte-2b159159-f5fa-4e22-88d9-b8088cab4801" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Lock "cinder-quobyte-2b159159-f5fa-4e22-88d9-b8088cab4801" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa54530-15b5-443b-8236-fe5c0a334755]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:51 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:51 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:51 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 Jul 18 05:46:51 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:51 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.452s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:51 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 Jul 18 05:46:51 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:51 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801" returned: 0 in 0.432s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:51 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801 Jul 18 05:46:51 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:52 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b159159-f5fa-4e22-88d9-b8088cab4801" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Lock "cinder-quobyte-2b159159-f5fa-4e22-88d9-b8088cab4801" released by "delete_volume" :: held 0.795s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=166,cinder:UPDATE=189,cinder:INSERT=57,cinder:DELETE=16 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:46:52 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138" returned: 0 in 0.451s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Created reservations ['e7106543-59e9-4668-8fa0-6603cdb064b8', '49c38c85-e704-43c9-a683-4d9ea84c5598', '912dd8ab-3183-4180-96a8-0ac7e9beaf30', 'd1d77e08-dfed-4453-87c3-e19b706c0dc9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:52 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138 Jul 18 05:46:52 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:52 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:46:52 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:52 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138" returned: 0 in 0.356s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138" released by "_delete_snapshot" :: held 1.806s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" released by "delete_snapshot" :: held 1.846s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:52 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:46:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Deleted volume successfully. Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c11883a8-82e5-4a81-9f00-b12290b5b1d7 tempest-VolumesExtendTest-1912949289 None] Lock "cinder-2b159159-f5fa-4e22-88d9-b8088cab4801-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Created reservations ['e172f494-0358-4ce6-93b9-2e1cf7111cf0', 'cdf05a53-c67d-4885-9ce9-0d72084d470b', '833feaa7-a2dd-43e7-bd92-32362c1746be', '7be03dd2-b0e0-4a2d-ae6d-240d1c80dcbe'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Delete snapshot completed successfully. Jul 18 05:46:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33be85df-6d7a-4b9e-97ab-f280de777f9b tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-1bda01e6-bd04-4bbe-9b1c-eefc1a3cd138-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Creating offline snapshot 1f0c9ee8-8cf1-4f22-b07e-154de9675197 of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:46:53 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae743e3d-adff-4eea-8158-d525ce46720e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:53 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:53 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:53 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.444s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:53 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 1G Jul 18 05:46:53 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:54 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 1G" returned: 0 in 0.573s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:54 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 Jul 18 05:46:54 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:54 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197" returned: 0 in 0.351s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:54 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 is being set with open permissions: ugo+rw Jul 18 05:46:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:54 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 Jul 18 05:46:54 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:55 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.780s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-dc5aeefd-1042-48e4-ae09-14e123bc4bb5 tempest-SnapshotsActionsTest-471952212 None] Create snapshot completed successfully Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-1f0c9ee8-8cf1-4f22-b07e-154de9675197-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-1f0c9ee8-8cf1-4f22-b07e-154de9675197-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Acquiring lock "cinder-quobyte-1f0c9ee8-8cf1-4f22-b07e-154de9675197" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-1f0c9ee8-8cf1-4f22-b07e-154de9675197" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Deleting offline snapshot 1f0c9ee8-8cf1-4f22-b07e-154de9675197 of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] snapshot_file for this snap is: volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f2134c-5265-444f-9b39-ad44f0bab6ed]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:55 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 Jul 18 05:46:55 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:56 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197" returned: 0 in 0.454s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfdc165-d3f6-41bc-b101-500e9788f620]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Flow 'volume_create_manager' (395c379d-35c7-4806-bb18-9941905be267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e309fedc-3b6e-49af-bad6-3e132dd44cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e309fedc-3b6e-49af-bad6-3e132dd44cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1962972751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b458149-8d96-4091-8f9e-6e475ad580a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4810019d1c014ce280ea1f772a04c893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:56Z,use_quota=True,user_id='afb5cede4f774a17bcd47d9e406640cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf73fca-c9d7-4a98-a4ff-63ddeb1f2bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf73fca-c9d7-4a98-a4ff-63ddeb1f2bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1358443b-8042-4c6e-83c5-6cd1cbd3edbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:56 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:56 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1358443b-8042-4c6e-83c5-6cd1cbd3edbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b458149-8d96-4091-8f9e-6e475ad580a8', 'volume_name': 'volume-2b458149-8d96-4091-8f9e-6e475ad580a8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5d11a0-b092-4b6f-ade1-c7836e0207ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5d11a0-b092-4b6f-ade1-c7836e0207ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8a3334-bd57-4be0-a543-38f68241dfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:56 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Volume 2b458149-8d96-4091-8f9e-6e475ad580a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b458149-8d96-4091-8f9e-6e475ad580a8', 'volume_size': 1} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1962972751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b458149-8d96-4091-8f9e-6e475ad580a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4810019d1c014ce280ea1f772a04c893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:56Z,use_quota=True,user_id='afb5cede4f774a17bcd47d9e406640cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Creating volume 2b458149-8d96-4091-8f9e-6e475ad580a8 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:56 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:56 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8 1073741824 Jul 18 05:46:56 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:56 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.398s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:56 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 Jul 18 05:46:56 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:56 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8 1073741824" returned: 0 in 0.491s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:56 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8 Jul 18 05:46:56 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:56 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197" returned: 0 in 0.470s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:57 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197 Jul 18 05:46:57 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:57 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8" returned: 0 in 0.299s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8a3334-bd57-4be0-a543-38f68241dfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b458149-8d96-4091-8f9e-6e475ad580a8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803e5463-af0a-4a54-9409-87314b61ed6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:57 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Volume volume-2b458149-8d96-4091-8f9e-6e475ad580a8 (2b458149-8d96-4091-8f9e-6e475ad580a8): created successfully Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803e5463-af0a-4a54-9409-87314b61ed6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Flow 'volume_create_manager' (395c379d-35c7-4806-bb18-9941905be267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f64270d8-44af-44a4-b47b-aa7ca9fa5efb tempest-VolumesListTestJSON-236599081 None] Created volume successfully. Jul 18 05:46:57 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.1f0c9ee8-8cf1-4f22-b07e-154de9675197" returned: 0 in 0.264s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-1f0c9ee8-8cf1-4f22-b07e-154de9675197" released by "_delete_snapshot" :: held 1.694s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" released by "delete_snapshot" :: held 1.723s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Created reservations ['0749c003-9ce5-4446-8a41-748f662433aa', '0ee71e7c-1373-4e1d-9f76-73fb1b6ed07d', '85f10ff4-43d4-4706-bce0-7c7b055a04d8', '19223ba5-1001-4832-bbaa-ef0bd1032441'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Delete snapshot completed successfully. Jul 18 05:46:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-77124b15-01e2-4710-83ec-ab908ee4a589 tempest-SnapshotsActionsTest-1679173361 None] Lock "cinder-1f0c9ee8-8cf1-4f22-b07e-154de9675197-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "cinder-b0918931-1784-4c51-8781-20c6a980debc-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-b0918931-1784-4c51-8781-20c6a980debc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "cinder-quobyte-b0918931-1784-4c51-8781-20c6a980debc" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-quobyte-b0918931-1784-4c51-8781-20c6a980debc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Deleting offline snapshot b0918931-1784-4c51-8781-20c6a980debc of volume 308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] snapshot_file for this snap is: volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c10be37-be01-4776-bf7f-b3a274de70ec]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:58 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:58 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:58 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.466s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308de490-2a45-467a-bbac-9382da2e59f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[832b924e-5bf6-4782-be36-65549def90a7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:46:58 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 Jul 18 05:46:58 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Flow 'volume_create_manager' (a901217c-f95c-4869-acdb-5cc95aa1e257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94db267a-9c61-4afe-8441-df618a8278bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94db267a-9c61-4afe-8441-df618a8278bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1252315656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7449e2-fa5c-4238-a945-e662699d466f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4810019d1c014ce280ea1f772a04c893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:59Z,use_quota=True,user_id='afb5cede4f774a17bcd47d9e406640cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288cea4a-10b7-4431-abc0-d56903362dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288cea4a-10b7-4431-abc0-d56903362dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae6026f-33f6-41f0-a8c4-ea926ab487b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae6026f-33f6-41f0-a8c4-ea926ab487b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7449e2-fa5c-4238-a945-e662699d466f', 'volume_name': 'volume-1f7449e2-fa5c-4238-a945-e662699d466f', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f25e98-3228-4a8c-8f99-61fed9a1c2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f25e98-3228-4a8c-8f99-61fed9a1c2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807c2619-dc87-4f2c-b2f8-10c474faadc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:58 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Volume 1f7449e2-fa5c-4238-a945-e662699d466f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7449e2-fa5c-4238-a945-e662699d466f', 'volume_size': 1} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1252315656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7449e2-fa5c-4238-a945-e662699d466f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4810019d1c014ce280ea1f772a04c893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:46:59Z,use_quota=True,user_id='afb5cede4f774a17bcd47d9e406640cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Creating volume 1f7449e2-fa5c-4238-a945-e662699d466f {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:46:58 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:46:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:58 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f 1073741824 Jul 18 05:46:58 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:59 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4" returned: 0 in 0.412s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:59 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:59 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:59 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f 1073741824" returned: 0 in 0.535s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:59 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.383s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:46:59 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f Jul 18 05:46:59 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:59 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc Jul 18 05:46:59 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:46:59 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f" returned: 0 in 0.265s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807c2619-dc87-4f2c-b2f8-10c474faadc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7449e2-fa5c-4238-a945-e662699d466f', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c77067f-0f56-4435-8fd2-809388fb6619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:46:59 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4.b0918931-1784-4c51-8781-20c6a980debc" returned: 0 in 0.282s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:46:59 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Volume volume-1f7449e2-fa5c-4238-a945-e662699d466f (1f7449e2-fa5c-4238-a945-e662699d466f): created successfully Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c77067f-0f56-4435-8fd2-809388fb6619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Flow 'volume_create_manager' (a901217c-f95c-4869-acdb-5cc95aa1e257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:46:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-82c42a0f-5a0d-48cf-891b-ebd8ccc6adaa tempest-VolumesListTestJSON-236599081 None] Created volume successfully. Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-quobyte-b0918931-1784-4c51-8781-20c6a980debc" released by "_delete_snapshot" :: held 1.708s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" released by "delete_snapshot" :: held 1.736s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Created reservations ['aa8c6c94-4020-46d3-82fd-7b4d6228e833', 'f9ba7444-d9fa-411a-ac74-d871b93d7af6', '0ac63d69-9a9f-4dc0-9a57-dd62167dcba3', 'c18eb2e2-2624-45d5-ad0a-d89bbee37d72'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:46:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Delete snapshot completed successfully. Jul 18 05:46:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-360b9f82-4743-42a8-bd48-99460af06d1a tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-b0918931-1784-4c51-8781-20c6a980debc-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "cinder-308de490-2a45-467a-bbac-9382da2e59f4-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-308de490-2a45-467a-bbac-9382da2e59f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:00 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbd4e1e-7e63-49a3-bcf9-0e03185e7c72]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:00 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 Jul 18 05:47:00 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:00 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4" returned: 0 in 0.388s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:00 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4 Jul 18 05:47:00 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:01 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-308de490-2a45-467a-bbac-9382da2e59f4" returned: 0 in 0.260s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-quobyte-308de490-2a45-467a-bbac-9382da2e59f4" released by "delete_volume" :: held 0.718s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Created reservations ['1a345d4d-6d4d-4584-9694-7c565355deeb', '2aaceb5b-bae6-4d08-a1cb-ea1ca54718bf', '4775d315-f9e4-43b3-a025-b79fa0ef764e', '8fbd27a5-0363-454f-abb8-36849bf90a3e'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:01 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:01 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Flow 'volume_create_manager' (051631cf-83cc-4473-a9c2-bad7e272f963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0deb7b-a050-4705-90af-dbd5cd48d362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0deb7b-a050-4705-90af-dbd5cd48d362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-86043293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beccb172-7a29-46ee-b0ae-19b78b443ccd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4810019d1c014ce280ea1f772a04c893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:02Z,use_quota=True,user_id='afb5cede4f774a17bcd47d9e406640cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d658131f-bb5a-4d73-8a86-cb9313ef75bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d658131f-bb5a-4d73-8a86-cb9313ef75bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc31c8e-67be-4ccd-9587-1ffffa4320cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc31c8e-67be-4ccd-9587-1ffffa4320cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beccb172-7a29-46ee-b0ae-19b78b443ccd', 'volume_name': 'volume-beccb172-7a29-46ee-b0ae-19b78b443ccd', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a075be63-43e9-41b3-b88b-04af9b732c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a075be63-43e9-41b3-b88b-04af9b732c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:01 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170711a5-e353-4550-880a-218586a0edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:01 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Volume beccb172-7a29-46ee-b0ae-19b78b443ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beccb172-7a29-46ee-b0ae-19b78b443ccd', 'volume_size': 1} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-86043293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beccb172-7a29-46ee-b0ae-19b78b443ccd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4810019d1c014ce280ea1f772a04c893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:02Z,use_quota=True,user_id='afb5cede4f774a17bcd47d9e406640cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Creating volume beccb172-7a29-46ee-b0ae-19b78b443ccd {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:01 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.370s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:01 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Deleted volume successfully. Jul 18 05:47:01 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd 1073741824 Jul 18 05:47:01 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-56988e45-e235-4105-ae3e-7763549d6eed tempest-SnapshotsActionsTest-471952212 None] Lock "cinder-308de490-2a45-467a-bbac-9382da2e59f4-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:02 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd 1073741824" returned: 0 in 0.560s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:02 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd Jul 18 05:47:02 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:02 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd" returned: 0 in 0.301s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170711a5-e353-4550-880a-218586a0edfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beccb172-7a29-46ee-b0ae-19b78b443ccd', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b529291c-8588-4ec7-afd3-19b2ea72aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:02 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Volume volume-beccb172-7a29-46ee-b0ae-19b78b443ccd (beccb172-7a29-46ee-b0ae-19b78b443ccd): created successfully Jul 18 05:47:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b529291c-8588-4ec7-afd3-19b2ea72aa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Flow 'volume_create_manager' (051631cf-83cc-4473-a9c2-bad7e272f963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ff6c1e5e-1cd5-40dc-ab79-7b49392b6b1d tempest-VolumesListTestJSON-236599081 None] Created volume successfully. Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:06 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:06 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:06 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.425s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Acquiring lock "cinder-beccb172-7a29-46ee-b0ae-19b78b443ccd-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Lock "cinder-beccb172-7a29-46ee-b0ae-19b78b443ccd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Acquiring lock "cinder-quobyte-beccb172-7a29-46ee-b0ae-19b78b443ccd" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Lock "cinder-quobyte-beccb172-7a29-46ee-b0ae-19b78b443ccd" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e39b5e-16bb-4d6a-b797-deac233c35d6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:07 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd Jul 18 05:47:07 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:07 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd" returned: 0 in 0.511s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:07 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd Jul 18 05:47:07 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:07 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-beccb172-7a29-46ee-b0ae-19b78b443ccd" returned: 0 in 0.309s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Lock "cinder-quobyte-beccb172-7a29-46ee-b0ae-19b78b443ccd" released by "delete_volume" :: held 0.883s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Created reservations ['91c6ecdd-d4ee-4a41-98e0-de432c048fd4', '41fb82ee-7643-4c0e-952c-4ea88be56bbc', '1ce5d0ba-ae6e-4e28-8c2e-710c3d6e48d2', '2522cbba-7dec-405d-9d1a-6824907fcab4'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:07 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:07 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Acquiring lock "cinder-1f7449e2-fa5c-4238-a945-e662699d466f-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Lock "cinder-1f7449e2-fa5c-4238-a945-e662699d466f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Acquiring lock "cinder-quobyte-1f7449e2-fa5c-4238-a945-e662699d466f" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Lock "cinder-quobyte-1f7449e2-fa5c-4238-a945-e662699d466f" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f6606-cfa5-4557-bf5f-d7ae29380703]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:08 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.418s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:08 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Deleted volume successfully. Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ffb14432-4adc-4875-ae64-07adde33d8aa tempest-VolumesListTestJSON-236599081 None] Lock "cinder-beccb172-7a29-46ee-b0ae-19b78b443ccd-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:08 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f Jul 18 05:47:08 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:08 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f" returned: 0 in 0.573s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:08 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f Jul 18 05:47:08 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:09 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f7449e2-fa5c-4238-a945-e662699d466f" returned: 0 in 0.328s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Lock "cinder-quobyte-1f7449e2-fa5c-4238-a945-e662699d466f" released by "delete_volume" :: held 0.950s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Created reservations ['69e8f74d-a21e-4c64-baa4-4f576a1b6e53', '74958d96-6575-41ca-b026-7903ed47e062', '738ce38c-8410-4ccf-8f8d-72f903b20119', 'bde2c7b5-f012-429d-b760-87c490762498'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:09 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:09 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:09 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.273s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:09 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Deleted volume successfully. Jul 18 05:47:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9eedc855-0eb3-4ad0-befd-b929a4109de2 tempest-VolumesListTestJSON-236599081 None] Lock "cinder-1f7449e2-fa5c-4238-a945-e662699d466f-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Acquiring lock "cinder-2b458149-8d96-4091-8f9e-6e475ad580a8-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Lock "cinder-2b458149-8d96-4091-8f9e-6e475ad580a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Acquiring lock "cinder-quobyte-2b458149-8d96-4091-8f9e-6e475ad580a8" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Lock "cinder-quobyte-2b458149-8d96-4091-8f9e-6e475ad580a8" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:10 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d4838b-67b9-41d3-bfe9-dcd53194a175]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:10 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8 Jul 18 05:47:10 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:10 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8" returned: 0 in 0.388s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:11 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8 Jul 18 05:47:11 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:11 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2b458149-8d96-4091-8f9e-6e475ad580a8" returned: 0 in 0.303s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Lock "cinder-quobyte-2b458149-8d96-4091-8f9e-6e475ad580a8" released by "delete_volume" :: held 0.756s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Created reservations ['83f30a71-8f44-4381-95e0-0f4913f44e04', '38547677-4933-40fb-b10e-525bd5b81b09', '462957ba-d2ea-4875-ba78-6235c0019fe8', '4f31bc8a-3c43-4e76-8187-c5cbca5b9d05'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:11 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:11 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:11 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.310s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:11 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Deleted volume successfully. Jul 18 05:47:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19a3f4a6-d3ea-46bb-b67c-80e3ce80795e tempest-VolumesListTestJSON-236599081 None] Lock "cinder-2b458149-8d96-4091-8f9e-6e475ad580a8-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Flow 'volume_create_manager' (7bf764f4-8a2c-4e96-82a8-805f334cb568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60eeb67f-a683-4b4e-afc8-5f053b937b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60eeb67f-a683-4b4e-afc8-5f053b937b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-717717382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209e43ac-ba86-42b6-94aa-be89bd4fd051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28269f6eb3fb450bb795b35760ff666e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:15Z,use_quota=True,user_id='04e70cebdddd40a2b076995692775c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a03016-7994-40ae-8dde-7a26f5345a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a03016-7994-40ae-8dde-7a26f5345a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547f6b17-db5e-440b-9930-f92166550697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547f6b17-db5e-440b-9930-f92166550697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209e43ac-ba86-42b6-94aa-be89bd4fd051', 'volume_name': 'volume-209e43ac-ba86-42b6-94aa-be89bd4fd051', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b192b067-1898-4e1b-8238-3a8d7c5e56eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b192b067-1898-4e1b-8238-3a8d7c5e56eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d04038f-99ec-4d62-bccd-29d38c583088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Volume 209e43ac-ba86-42b6-94aa-be89bd4fd051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209e43ac-ba86-42b6-94aa-be89bd4fd051', 'volume_size': 1} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-717717382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209e43ac-ba86-42b6-94aa-be89bd4fd051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28269f6eb3fb450bb795b35760ff666e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:15Z,use_quota=True,user_id='04e70cebdddd40a2b076995692775c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Creating volume 209e43ac-ba86-42b6-94aa-be89bd4fd051 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:15 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:15 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 1073741824 Jul 18 05:47:15 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:16 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 1073741824" returned: 0 in 0.536s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:16 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 Jul 18 05:47:16 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:16 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051" returned: 0 in 0.275s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d04038f-99ec-4d62-bccd-29d38c583088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209e43ac-ba86-42b6-94aa-be89bd4fd051', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96ad0bd-954b-40d4-874f-8a6d2fe44795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Volume volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 (209e43ac-ba86-42b6-94aa-be89bd4fd051): created successfully Jul 18 05:47:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96ad0bd-954b-40d4-874f-8a6d2fe44795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Flow 'volume_create_manager' (7bf764f4-8a2c-4e96-82a8-805f334cb568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:16 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2b9e0eca-80ea-4e6a-8754-9a6d2742d405 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Created volume successfully. Jul 18 05:47:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Acquiring lock "cinder-209e43ac-ba86-42b6-94aa-be89bd4fd051-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "cinder-209e43ac-ba86-42b6-94aa-be89bd4fd051-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Acquiring lock "cinder-quobyte-209e43ac-ba86-42b6-94aa-be89bd4fd051" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "cinder-quobyte-209e43ac-ba86-42b6-94aa-be89bd4fd051" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:18 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[903df780-f578-45a5-9711-18e32cadb7c3]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:19 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 Jul 18 05:47:19 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:19 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051" returned: 0 in 0.401s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:19 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051 Jul 18 05:47:19 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:19 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-209e43ac-ba86-42b6-94aa-be89bd4fd051" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "cinder-quobyte-209e43ac-ba86-42b6-94aa-be89bd4fd051" released by "delete_volume" :: held 0.744s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Created reservations ['c1d8a2b4-34ab-44a9-a39e-54fd52e45456', '48db3267-9d98-4b95-8b54-5f9790cfc424', '7cbeb0ed-737d-4c4d-978b-04f857a219d3', '968bb4f8-a047-43f5-a7cf-c553131ec008'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:19 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:19 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:20 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.360s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:20 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Deleted volume successfully. Jul 18 05:47:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-554eed21-3db7-45fa-8ed2-493245041f33 tempest-VolumeQuotasNegativeTestJSON-1506012628 None] Lock "cinder-209e43ac-ba86-42b6-94aa-be89bd4fd051-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:29 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Flow 'volume_create_manager' (cf803fe3-bf28-4a2c-a55c-bcd12177441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeca44e5-23fc-46cf-ae4c-551dff6d8e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeca44e5-23fc-46cf-ae4c-551dff6d8e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1830930539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e6d181-c4d9-4662-90d2-451488acd06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371bb23631ee4f6f9eb66989229fb280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:30Z,use_quota=True,user_id='11cab134fb3e4f5e8005f6f882112545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7fb647-7dca-42a2-9731-46e2785ada16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7fb647-7dca-42a2-9731-46e2785ada16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47af823a-acb9-4528-a331-e6d75093e712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47af823a-acb9-4528-a331-e6d75093e712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e6d181-c4d9-4662-90d2-451488acd06d', 'volume_name': 'volume-25e6d181-c4d9-4662-90d2-451488acd06d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f1825e-3959-42aa-8ef0-a1f1bab7affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f1825e-3959-42aa-8ef0-a1f1bab7affa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9705ee54-6610-473a-a0ea-87f2271a4c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:30 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Volume 25e6d181-c4d9-4662-90d2-451488acd06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e6d181-c4d9-4662-90d2-451488acd06d', 'volume_size': 1} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1830930539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e6d181-c4d9-4662-90d2-451488acd06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371bb23631ee4f6f9eb66989229fb280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:30Z,use_quota=True,user_id='11cab134fb3e4f5e8005f6f882112545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Creating volume 25e6d181-c4d9-4662-90d2-451488acd06d {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:30 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:30 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d 1073741824 Jul 18 05:47:30 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:30 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d 1073741824" returned: 0 in 0.872s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:30 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (e3dce37a-4cda-4631-963a-bc055d161b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7050b63-be3a-4859-8803-4b483e44af5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7050b63-be3a-4859-8803-4b483e44af5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-352532682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9efa32-252a-4831-a37a-b093b81dece2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:31Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84955983-0076-4cb0-b767-2f632a6e06c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84955983-0076-4cb0-b767-2f632a6e06c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2edcb7e-bb55-4926-97d0-96a64e2c3c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2edcb7e-bb55-4926-97d0-96a64e2c3c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9efa32-252a-4831-a37a-b093b81dece2', 'volume_name': 'volume-3f9efa32-252a-4831-a37a-b093b81dece2', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815f5205-444c-4e02-a932-75f617df2afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815f5205-444c-4e02-a932-75f617df2afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdc4cb5-0325-41ea-acb4-1cd2361a8be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Volume 3f9efa32-252a-4831-a37a-b093b81dece2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9efa32-252a-4831-a37a-b093b81dece2', 'volume_size': 1} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:31 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d Jul 18 05:47:31 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (0116c464-1d77-4ee3-8366-9d5fc1d30a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a32615f-568b-4ef7-a3bc-dba207d77c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a32615f-568b-4ef7-a3bc-dba207d77c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-535870325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c0aed1-d2c4-4046-ba89-69af162f02ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf1dd2aa7c455ebad35c0c4d7d5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:31Z,use_quota=True,user_id='5e0aff3d9a5240ba9d813b27d71b0a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffcab21-56b1-4755-a9c3-63b3c36e9f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffcab21-56b1-4755-a9c3-63b3c36e9f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332ede62-cebf-4a91-baaf-975f0fdc0501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332ede62-cebf-4a91-baaf-975f0fdc0501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c0aed1-d2c4-4046-ba89-69af162f02ff', 'volume_name': 'volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6809ecdf-a9f7-4a0e-bd55-a0aa9492f181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6809ecdf-a9f7-4a0e-bd55-a0aa9492f181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cf20b5-0c35-4fd6-89f2-16a324a6cecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Volume b2c0aed1-d2c4-4046-ba89-69af162f02ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff', 'volume_size': 1} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:31 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d" returned: 0 in 0.373s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-352532682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9efa32-252a-4831-a37a-b093b81dece2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:31Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Creating volume 3f9efa32-252a-4831-a37a-b093b81dece2 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:31 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9705ee54-6610-473a-a0ea-87f2271a4c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e6d181-c4d9-4662-90d2-451488acd06d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606d5ff1-7e2e-4579-a9e9-b867b214cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:31 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2 1073741824 Jul 18 05:47:31 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Volume volume-25e6d181-c4d9-4662-90d2-451488acd06d (25e6d181-c4d9-4662-90d2-451488acd06d): created successfully Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606d5ff1-7e2e-4579-a9e9-b867b214cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Flow 'volume_create_manager' (cf803fe3-bf28-4a2c-a55c-bcd12177441b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-282aef7f-2852-4119-8054-d5d4fdf14d72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Created volume successfully. Jul 18 05:47:32 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2 1073741824" returned: 0 in 0.516s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:32 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2 Jul 18 05:47:32 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:32 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2" returned: 0 in 0.283s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-535870325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c0aed1-d2c4-4046-ba89-69af162f02ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf1dd2aa7c455ebad35c0c4d7d5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:31Z,use_quota=True,user_id='5e0aff3d9a5240ba9d813b27d71b0a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Creating volume b2c0aed1-d2c4-4046-ba89-69af162f02ff {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:32 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdc4cb5-0325-41ea-acb4-1cd2361a8be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9efa32-252a-4831-a37a-b093b81dece2', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:32 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff 1073741824 Jul 18 05:47:32 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557ea4c9-2c8d-43fd-a0f6-a1e3d257a93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Volume volume-3f9efa32-252a-4831-a37a-b093b81dece2 (3f9efa32-252a-4831-a37a-b093b81dece2): created successfully Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557ea4c9-2c8d-43fd-a0f6-a1e3d257a93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (e3dce37a-4cda-4631-963a-bc055d161b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1637e6dd-57b3-41fb-a878-ab0a5e36be69 tempest-VolumesActionsTest-1146653520 None] Created volume successfully. Jul 18 05:47:32 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff 1073741824" returned: 0 in 0.425s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:32 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff Jul 18 05:47:32 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dffe7a39-2ae9-43a3-985e-115e35a8fbb6 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2" by "attach_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dffe7a39-2ae9-43a3-985e-115e35a8fbb6 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2" acquired by "attach_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-dffe7a39-2ae9-43a3-985e-115e35a8fbb6 tempest-VolumesActionsTest-1146653520 None] Attaching volume 3f9efa32-252a-4831-a37a-b093b81dece2 to instance b1d3a8e5-9b00-440b-8303-4c515304b2d2 at mountpoint /dev/vdb on host None. Jul 18 05:47:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-dffe7a39-2ae9-43a3-985e-115e35a8fbb6 tempest-VolumesActionsTest-1146653520 None] Attach volume completed successfully. Jul 18 05:47:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dffe7a39-2ae9-43a3-985e-115e35a8fbb6 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2" released by "attach_volume" :: held 0.098s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:33 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.860s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cf20b5-0c35-4fd6-89f2-16a324a6cecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391c0533-2720-46de-bdd6-75a85f5d907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Creating offline snapshot 0cf2ca83-4322-4a52-8f78-7a981bc16ebf of volume 25e6d181-c4d9-4662-90d2-451488acd06d {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:47:33 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Volume volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff (b2c0aed1-d2c4-4046-ba89-69af162f02ff): created successfully Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391c0533-2720-46de-bdd6-75a85f5d907a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (0116c464-1d77-4ee3-8366-9d5fc1d30a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a2c15-e618-4bdd-b34b-4910b6c608fc]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-aa296f34-982d-4010-8047-dc22e1857e9f tempest-VolumesSnapshotTestJSON-956399742 None] Created volume successfully. Jul 18 05:47:33 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d Jul 18 05:47:33 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2799a69a-9904-4c8a-8ced-d6e447bdcc67 tempest-VolumesActionsTest-896143051 None] Terminate volume connection completed successfully. Jul 18 05:47:33 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d" returned: 0 in 0.538s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:33 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf 1G Jul 18 05:47:33 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2799a69a-9904-4c8a-8ced-d6e447bdcc67 tempest-VolumesActionsTest-896143051 None] Acquiring lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2-detach_volume" by "detach_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2799a69a-9904-4c8a-8ced-d6e447bdcc67 tempest-VolumesActionsTest-896143051 None] Lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2799a69a-9904-4c8a-8ced-d6e447bdcc67 tempest-VolumesActionsTest-896143051 None] Detaching volume 3f9efa32-252a-4831-a37a-b093b81dece2 from instance b1d3a8e5-9b00-440b-8303-4c515304b2d2. Jul 18 05:47:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2799a69a-9904-4c8a-8ced-d6e447bdcc67 tempest-VolumesActionsTest-896143051 None] Detach volume completed successfully. Jul 18 05:47:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2799a69a-9904-4c8a-8ced-d6e447bdcc67 tempest-VolumesActionsTest-896143051 None] Lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-067247d4-d24a-4f7d-9b8f-0078b13e7769 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2-detach_volume" by "detach_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-067247d4-d24a-4f7d-9b8f-0078b13e7769 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:34 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-067247d4-d24a-4f7d-9b8f-0078b13e7769 tempest-VolumesActionsTest-1146653520 None] Volume detach called, but volume not attached. Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-067247d4-d24a-4f7d-9b8f-0078b13e7769 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:34 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf 1G" returned: 0 in 0.487s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25e6d181-c4d9-4662-90d2-451488acd06d -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:34 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25e6d181-c4d9-4662-90d2-451488acd06d -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf Jul 18 05:47:34 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "cinder-quobyte-3f9efa32-252a-4831-a37a-b093b81dece2" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-quobyte-3f9efa32-252a-4831-a37a-b093b81dece2" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9929a7-51ea-41cc-a817-0ff470e1677c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:34 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25e6d181-c4d9-4662-90d2-451488acd06d -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf" returned: 0 in 0.342s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:34 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf is being set with open permissions: ugo+rw Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:34 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2 Jul 18 05:47:34 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:34 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf Jul 18 05:47:34 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:34 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf" returned: 0 in 0.279s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:34 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2" returned: 0 in 0.393s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:34 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2 Jul 18 05:47:34 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:34 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.info Jul 18 05:47:34 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:35 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3f9efa32-252a-4831-a37a-b093b81dece2" returned: 0 in 0.266s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-quobyte-3f9efa32-252a-4831-a37a-b093b81dece2" released by "delete_volume" :: held 0.717s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:35 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.info" returned: 0 in 0.296s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:35 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.info is being set with open permissions: ugo+rw Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Created reservations ['a2c79e18-9135-4672-8291-79fcb7cd07d5', '451e9d49-9aa7-4a28-b052-3887da161842', '0a28b8a1-5711-408b-a9ff-609cf6a16eb7', '75fe02cd-e788-4476-8b8d-74bfc5007e38'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:35 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.info Jul 18 05:47:35 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:35 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:35 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:35 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.info" returned: 0 in 0.291s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.787s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Creating offline snapshot b473300a-8783-4ea2-bb1f-729e946047fb of volume b2c0aed1-d2c4-4046-ba89-69af162f02ff {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:47:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-904b4aed-c867-49fc-8feb-8b121740bf86 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Create snapshot completed successfully Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc71843-37ec-4181-9dc5-575ba2ea2723]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:35 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Deleted volume successfully. Jul 18 05:47:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fad0bd25-63ac-4d6e-91e5-dfbbbffdba23 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-3f9efa32-252a-4831-a37a-b093b81dece2-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:35 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff Jul 18 05:47:35 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:36 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff" returned: 0 in 0.458s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:36 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb 1G Jul 18 05:47:36 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:36 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb 1G" returned: 0 in 0.511s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:36 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb Jul 18 05:47:36 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:36 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb" returned: 0 in 0.365s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:36 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb is being set with open permissions: ugo+rw Jul 18 05:47:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:36 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb Jul 18 05:47:36 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Acquiring lock "cinder-0cf2ca83-4322-4a52-8f78-7a981bc16ebf-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-0cf2ca83-4322-4a52-8f78-7a981bc16ebf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Acquiring lock "cinder-quobyte-25e6d181-c4d9-4662-90d2-451488acd06d" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-quobyte-25e6d181-c4d9-4662-90d2-451488acd06d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Acquiring lock "cinder-quobyte-0cf2ca83-4322-4a52-8f78-7a981bc16ebf" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-quobyte-0cf2ca83-4322-4a52-8f78-7a981bc16ebf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Deleting offline snapshot 0cf2ca83-4322-4a52-8f78-7a981bc16ebf of volume 25e6d181-c4d9-4662-90d2-451488acd06d {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] snapshot_file for this snap is: volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[df34d58c-5cde-4cad-bf4b-674220ad7f60]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:37 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb" returned: 0 in 0.300s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:37 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.info Jul 18 05:47:37 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:37 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf Jul 18 05:47:37 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:37 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.info" returned: 0 in 0.327s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:37 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.info is being set with open permissions: ugo+rw Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:37 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.info Jul 18 05:47:37 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:37 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf" returned: 0 in 0.452s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25e6d181-c4d9-4662-90d2-451488acd06d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e421683e-2668-4bbd-9063-19635791da3f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:37 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d Jul 18 05:47:37 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:37 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.info" returned: 0 in 0.300s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-bcb9eda3-d5cb-4a02-9ccd-e559e77bf9c3 tempest-VolumesSnapshotTestJSON-956399742 None] Create snapshot completed successfully Jul 18 05:47:38 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d" returned: 0 in 0.419s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:38 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf Jul 18 05:47:38 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:38 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf" returned: 0 in 0.335s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:38 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf Jul 18 05:47:38 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:38 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d.0cf2ca83-4322-4a52-8f78-7a981bc16ebf" returned: 0 in 0.251s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-quobyte-0cf2ca83-4322-4a52-8f78-7a981bc16ebf" released by "_delete_snapshot" :: held 1.586s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-quobyte-25e6d181-c4d9-4662-90d2-451488acd06d" released by "delete_snapshot" :: held 1.617s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Created reservations ['9508d902-a0af-46c3-beeb-a6b45a9d2f7f', 'dd6b0817-b15c-4064-b394-453b03b3bc91', '35202a3c-1288-4f90-a990-9f6200f08cde', 'de912615-e44d-41f7-83b8-028e4a2f03c4'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:38 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Delete snapshot completed successfully. Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e812bd69-b7ea-4698-80e3-84d0a373f5a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-0cf2ca83-4322-4a52-8f78-7a981bc16ebf-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (e7613563-82bd-4b80-b5ea-37680879e163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be90b2d-5bb0-48a4-88fe-5b66d4f4f3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be90b2d-5bb0-48a4-88fe-5b66d4f4f3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1203460981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90cffe9-aad7-4381-9010-39669fd7517a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:39Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774e7ff9-a276-4fbf-a304-6dd6f9392a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774e7ff9-a276-4fbf-a304-6dd6f9392a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b194bef-fe7f-4bd2-b6ce-1b6ef9f64e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b194bef-fe7f-4bd2-b6ce-1b6ef9f64e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90cffe9-aad7-4381-9010-39669fd7517a', 'volume_name': 'volume-c90cffe9-aad7-4381-9010-39669fd7517a', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f09bce-962f-4c66-8678-063459cce1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f09bce-962f-4c66-8678-063459cce1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:38 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b182b1ad-cd2f-4c6d-82b1-670f8616f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:39 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Volume c90cffe9-aad7-4381-9010-39669fd7517a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90cffe9-aad7-4381-9010-39669fd7517a', 'volume_size': 1} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1203460981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90cffe9-aad7-4381-9010-39669fd7517a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:39Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Creating volume c90cffe9-aad7-4381-9010-39669fd7517a {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:39 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:39 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a 1073741824 Jul 18 05:47:39 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-b473300a-8783-4ea2-bb1f-729e946047fb-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-b473300a-8783-4ea2-bb1f-729e946047fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-b2c0aed1-d2c4-4046-ba89-69af162f02ff" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-b2c0aed1-d2c4-4046-ba89-69af162f02ff" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-b473300a-8783-4ea2-bb1f-729e946047fb" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-b473300a-8783-4ea2-bb1f-729e946047fb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Deleting offline snapshot b473300a-8783-4ea2-bb1f-729e946047fb of volume b2c0aed1-d2c4-4046-ba89-69af162f02ff {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] snapshot_file for this snap is: volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b71e8c-3ef8-4298-b575-628e6edb6499]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Acquiring lock "cinder-25e6d181-c4d9-4662-90d2-451488acd06d-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-25e6d181-c4d9-4662-90d2-451488acd06d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:39 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb Jul 18 05:47:39 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Acquiring lock "cinder-quobyte-25e6d181-c4d9-4662-90d2-451488acd06d" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-quobyte-25e6d181-c4d9-4662-90d2-451488acd06d" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffbb40a-85fb-4c4e-b386-70e9ca08a815]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:39 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a 1073741824" returned: 0 in 0.489s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:39 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a Jul 18 05:47:39 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:39 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d Jul 18 05:47:39 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:39 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb" returned: 0 in 0.430s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[523cfe83-a06e-4b6c-a2ed-5dc673c072b3]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:39 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff Jul 18 05:47:39 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:39 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a" returned: 0 in 0.265s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b182b1ad-cd2f-4c6d-82b1-670f8616f110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90cffe9-aad7-4381-9010-39669fd7517a', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2b1886-5d5c-4afa-8af1-06903e1d0d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:39 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Volume volume-c90cffe9-aad7-4381-9010-39669fd7517a (c90cffe9-aad7-4381-9010-39669fd7517a): created successfully Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2b1886-5d5c-4afa-8af1-06903e1d0d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (e7613563-82bd-4b80-b5ea-37680879e163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b871a0d3-4abc-48f9-b5a0-c262a0ad2edd tempest-VolumesActionsTest-1146653520 None] Created volume successfully. Jul 18 05:47:39 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d" returned: 0 in 0.416s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:39 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d Jul 18 05:47:39 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:40 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff" returned: 0 in 0.376s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:40 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb Jul 18 05:47:40 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:40 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-25e6d181-c4d9-4662-90d2-451488acd06d" returned: 0 in 0.255s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-quobyte-25e6d181-c4d9-4662-90d2-451488acd06d" released by "delete_volume" :: held 0.732s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Created reservations ['411dd731-a301-4054-8e85-ebb4306093b2', '93f228cb-0cf1-4e60-9643-a46564dee1a1', '2229d179-e95f-47f8-97ff-0b57d29fcf9e', '197a47c7-2eb2-44fe-9f05-a99898e01406'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:40 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:40 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:40 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb" returned: 0 in 0.359s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:40 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb Jul 18 05:47:40 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:40 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.262s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Deleted volume successfully. Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4ab0a655-366c-4644-b93f-55c40342cb25 tempest-VolumeSnapshotQuotasNegativeTestJSON-1484379291 None] Lock "cinder-25e6d181-c4d9-4662-90d2-451488acd06d-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:40 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff.b473300a-8783-4ea2-bb1f-729e946047fb" returned: 0 in 0.263s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-b473300a-8783-4ea2-bb1f-729e946047fb" released by "_delete_snapshot" :: held 1.542s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-b2c0aed1-d2c4-4046-ba89-69af162f02ff" released by "delete_snapshot" :: held 1.575s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Created reservations ['df76ceab-473d-414e-b880-d803547f4a86', '38eac1d1-7ea1-4900-9641-9c46b123b351', '24fbd97d-54cb-4a49-bec9-914a530c0fd4', '891b3c23-d900-4775-9852-42a76974de05'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Delete snapshot completed successfully. Jul 18 05:47:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-244463b4-4af6-48b6-87a6-44f94fc71de7 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-b473300a-8783-4ea2-bb1f-729e946047fb-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Acquiring lock "cinder-c90cffe9-aad7-4381-9010-39669fd7517a-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Lock "cinder-c90cffe9-aad7-4381-9010-39669fd7517a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Acquiring lock "cinder-quobyte-c90cffe9-aad7-4381-9010-39669fd7517a" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Lock "cinder-quobyte-c90cffe9-aad7-4381-9010-39669fd7517a" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8796547f-5d1f-4750-b5a8-d0f579514a18]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:41 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a Jul 18 05:47:41 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:41 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a" returned: 0 in 0.458s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:41 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a Jul 18 05:47:41 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (c2fa0974-2bd0-4679-9276-ec731e15033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2cf741-f8d6-47be-b405-286451c4baca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2cf741-f8d6-47be-b405-286451c4baca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-510318082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184b30e4-a837-4009-92ca-2c1417bf1fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf1dd2aa7c455ebad35c0c4d7d5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:42Z,use_quota=True,user_id='5e0aff3d9a5240ba9d813b27d71b0a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21a8eec-eeec-47a8-a4d7-a2e792e52f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21a8eec-eeec-47a8-a4d7-a2e792e52f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9633b2-62be-4862-a4be-09de6711a095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9633b2-62be-4862-a4be-09de6711a095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184b30e4-a837-4009-92ca-2c1417bf1fb8', 'volume_name': 'volume-184b30e4-a837-4009-92ca-2c1417bf1fb8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2697e1-b573-4ed6-a5ae-83c0f8fe0755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2697e1-b573-4ed6-a5ae-83c0f8fe0755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2aeabc4-4633-42cb-a858-4e6501de7750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:41 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Volume 184b30e4-a837-4009-92ca-2c1417bf1fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184b30e4-a837-4009-92ca-2c1417bf1fb8', 'volume_size': 1} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-510318082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184b30e4-a837-4009-92ca-2c1417bf1fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf1dd2aa7c455ebad35c0c4d7d5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:42Z,use_quota=True,user_id='5e0aff3d9a5240ba9d813b27d71b0a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Creating volume 184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:41 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:42 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 1073741824 Jul 18 05:47:42 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:42 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c90cffe9-aad7-4381-9010-39669fd7517a" returned: 0 in 0.349s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Lock "cinder-quobyte-c90cffe9-aad7-4381-9010-39669fd7517a" released by "delete_volume" :: held 0.872s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Created reservations ['3d868872-c5ea-48a1-bbbe-1590a97e2c15', '82dadba9-4f98-4070-98f3-eda77e63f647', '5775a1c4-e039-4bb5-9b8d-944942050f77', 'b82d4957-76f1-4772-ba90-83de38cc24d7'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:42 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:42 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:42 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 1073741824" returned: 0 in 0.565s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:42 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 Jul 18 05:47:42 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:42 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.367s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Deleted volume successfully. Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-381f0efb-2389-4a25-aac1-70a44bf4f701 tempest-VolumesActionsTest-896143051 None] Lock "cinder-c90cffe9-aad7-4381-9010-39669fd7517a-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:42 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8" returned: 0 in 0.294s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2aeabc4-4633-42cb-a858-4e6501de7750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184b30e4-a837-4009-92ca-2c1417bf1fb8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5517cda4-d889-42bd-abe5-1e24eee49466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:42 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Volume volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 (184b30e4-a837-4009-92ca-2c1417bf1fb8): created successfully Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5517cda4-d889-42bd-abe5-1e24eee49466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (c2fa0974-2bd0-4679-9276-ec731e15033e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c7d63eee-33fd-46bb-953a-9b199a78df4f tempest-VolumesSnapshotTestJSON-956399742 None] Created volume successfully. Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (af965a3e-2231-4a41-90d5-2d40f9e7f4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3af5cb-4a58-40ee-b04d-4f00aaafa56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3af5cb-4a58-40ee-b04d-4f00aaafa56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-403118271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0825c941-1a15-40ab-a334-6e834a73296d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:43Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485fcd09-42fa-499a-9753-60de0b8c5f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485fcd09-42fa-499a-9753-60de0b8c5f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81f1f0d-8ca7-400d-9f87-2402021335f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81f1f0d-8ca7-400d-9f87-2402021335f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0825c941-1a15-40ab-a334-6e834a73296d', 'volume_name': 'volume-0825c941-1a15-40ab-a334-6e834a73296d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91097727-7ccf-45d1-ac52-fa5721b4a355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91097727-7ccf-45d1-ac52-fa5721b4a355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6baf3f-b625-4a7b-904b-80538a1cd194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:43 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Volume 0825c941-1a15-40ab-a334-6e834a73296d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0825c941-1a15-40ab-a334-6e834a73296d', 'volume_size': 1} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-403118271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0825c941-1a15-40ab-a334-6e834a73296d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:43Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Creating volume 0825c941-1a15-40ab-a334-6e834a73296d {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:43 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:43 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d 1073741824 Jul 18 05:47:43 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:43 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d 1073741824" returned: 0 in 0.472s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:43 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d Jul 18 05:47:43 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:43 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d" returned: 0 in 0.274s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6baf3f-b625-4a7b-904b-80538a1cd194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0825c941-1a15-40ab-a334-6e834a73296d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c53fd5-080e-4003-bc94-6ddb6b5f3d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:43 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Volume volume-0825c941-1a15-40ab-a334-6e834a73296d (0825c941-1a15-40ab-a334-6e834a73296d): created successfully Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c53fd5-080e-4003-bc94-6ddb6b5f3d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (af965a3e-2231-4a41-90d5-2d40f9e7f4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0fed9202-a83b-49c6-b24f-b2f73ec6e21b tempest-VolumesActionsTest-1146653520 None] Created volume successfully. Jul 18 05:47:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Creating offline snapshot 3b41a88e-079a-4b49-8441-81270e682dab of volume 184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:47:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7c2da8-cb73-4040-9621-3897ffdd5a2e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:44 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 Jul 18 05:47:44 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:44 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8" returned: 0 in 0.368s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:44 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab 1G Jul 18 05:47:44 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:45 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab 1G" returned: 0 in 0.432s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:45 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab Jul 18 05:47:45 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Acquiring lock "cinder-0825c941-1a15-40ab-a334-6e834a73296d-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Lock "cinder-0825c941-1a15-40ab-a334-6e834a73296d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Acquiring lock "cinder-quobyte-0825c941-1a15-40ab-a334-6e834a73296d" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Lock "cinder-quobyte-0825c941-1a15-40ab-a334-6e834a73296d" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b672a394-5bbd-41ad-9425-33a0b557958f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:45 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab" returned: 0 in 0.379s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:45 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab is being set with open permissions: ugo+rw Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:45 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab Jul 18 05:47:45 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:45 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d Jul 18 05:47:45 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:45 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab" returned: 0 in 0.279s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:45 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d" returned: 0 in 0.381s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:45 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.info Jul 18 05:47:45 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:45 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d Jul 18 05:47:45 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:45 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.info" returned: 0 in 0.270s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:45 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.info is being set with open permissions: ugo+rw Jul 18 05:47:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:46 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-0825c941-1a15-40ab-a334-6e834a73296d" returned: 0 in 0.279s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:46 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.info Jul 18 05:47:46 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Lock "cinder-quobyte-0825c941-1a15-40ab-a334-6e834a73296d" released by "delete_volume" :: held 0.709s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Created reservations ['8e50be04-15eb-41e9-90d9-186b0663fa19', 'd58c2e5d-6eef-4590-b37a-f5cfcbbf3a4e', 'a8be2353-40fd-4659-9d32-1c8ee761d4ca', '186c061e-3c96-4358-89ce-ff16a6388a1f'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:46 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:46 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:46 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.info" returned: 0 in 0.280s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a3d17ce5-ef4e-43d0-a008-7622a530e373 tempest-VolumesSnapshotTestJSON-956399742 None] Create snapshot completed successfully Jul 18 05:47:46 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.319s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Deleted volume successfully. Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-69b0543e-55d8-4da4-999b-7a80361f2c2c tempest-VolumesActionsTest-896143051 None] Lock "cinder-0825c941-1a15-40ab-a334-6e834a73296d-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (f2540a12-55d8-4341-9647-77c887f0beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f65e1bc-4165-444d-9662-7f3d283be4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f65e1bc-4165-444d-9662-7f3d283be4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-734953584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b841b31-5218-485f-a830-bbd41b077fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:47Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9229148-5567-4f06-8bfa-556d05a49998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9229148-5567-4f06-8bfa-556d05a49998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d0d7e9-8dcf-42ad-b02d-f4c1fd878c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d0d7e9-8dcf-42ad-b02d-f4c1fd878c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b841b31-5218-485f-a830-bbd41b077fb3', 'volume_name': 'volume-7b841b31-5218-485f-a830-bbd41b077fb3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccae8879-34ab-4fda-a248-f04f738f26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccae8879-34ab-4fda-a248-f04f738f26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4d5c31-2691-46f4-84cc-084f2ed490c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:47 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Volume 7b841b31-5218-485f-a830-bbd41b077fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b841b31-5218-485f-a830-bbd41b077fb3', 'volume_size': 1} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-734953584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b841b31-5218-485f-a830-bbd41b077fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:47Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Creating volume 7b841b31-5218-485f-a830-bbd41b077fb3 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:47 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:47 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3 1073741824 Jul 18 05:47:47 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:47 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3 1073741824" returned: 0 in 0.487s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:47 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3 Jul 18 05:47:47 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:47 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3" returned: 0 in 0.366s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4d5c31-2691-46f4-84cc-084f2ed490c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b841b31-5218-485f-a830-bbd41b077fb3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0dc9413-6476-4572-8735-f5f673214223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:48 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Volume volume-7b841b31-5218-485f-a830-bbd41b077fb3 (7b841b31-5218-485f-a830-bbd41b077fb3): created successfully Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0dc9413-6476-4572-8735-f5f673214223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (f2540a12-55d8-4341-9647-77c887f0beb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:48 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7329c558-c5d1-494c-a3b4-2e837bde11ae tempest-VolumesActionsTest-1146653520 None] Created volume successfully. Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (9bfe3807-feec-4432-a8d6-a7358f8a841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886e0889-e724-4adb-865b-9025ba4eb718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886e0889-e724-4adb-865b-9025ba4eb718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-378067385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef5955d-7557-488d-b2e9-2a63d8547739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf1dd2aa7c455ebad35c0c4d7d5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3b41a88e-079a-4b49-8441-81270e682dab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:48Z,use_quota=True,user_id='5e0aff3d9a5240ba9d813b27d71b0a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fbdd5c-102a-4e3c-849e-0404c76c587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fbdd5c-102a-4e3c-849e-0404c76c587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90128640-6559-4303-aef6-176d767df575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90128640-6559-4303-aef6-176d767df575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fef5955d-7557-488d-b2e9-2a63d8547739', 'volume_name': 'volume-fef5955d-7557-488d-b2e9-2a63d8547739', 'volume_size': 2, 'snapshot_id': '3b41a88e-079a-4b49-8441-81270e682dab'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd55b08-6f35-4315-baff-78f912da5374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd55b08-6f35-4315-baff-78f912da5374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da51953b-1527-46a7-9549-4283baac59af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:48 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Volume fef5955d-7557-488d-b2e9-2a63d8547739: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fef5955d-7557-488d-b2e9-2a63d8547739', 'volume_size': 2, 'snapshot_id': '3b41a88e-079a-4b49-8441-81270e682dab'} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-3b41a88e-079a-4b49-8441-81270e682dab-fef5955d-7557-488d-b2e9-2a63d8547739" by "_create_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-3b41a88e-079a-4b49-8441-81270e682dab-fef5955d-7557-488d-b2e9-2a63d8547739" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Creating volume fef5955d-7557-488d-b2e9-2a63d8547739 from snapshot 3b41a88e-079a-4b49-8441-81270e682dab {{(pid=87497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-fef5955d-7557-488d-b2e9-2a63d8547739" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-fef5955d-7557-488d-b2e9-2a63d8547739" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] snapshot: 3b41a88e-079a-4b49-8441-81270e682dab, volume: fef5955d-7557-488d-b2e9-2a63d8547739, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929e400-c488-4bd0-857f-5edba5ab5565]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:48 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab Jul 18 05:47:48 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:48 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab" returned: 0 in 0.394s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-184b30e4-a837-4009-92ca-2c1417bf1fb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[127024ce-4975-4ea9-800f-9ea969af4829]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:48 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 Jul 18 05:47:48 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:49 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8" returned: 0 in 0.437s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:49 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:47:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:49 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 Jul 18 05:47:49 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Acquiring lock "cinder-7b841b31-5218-485f-a830-bbd41b077fb3-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Lock "cinder-7b841b31-5218-485f-a830-bbd41b077fb3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Acquiring lock "cinder-quobyte-7b841b31-5218-485f-a830-bbd41b077fb3" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Lock "cinder-quobyte-7b841b31-5218-485f-a830-bbd41b077fb3" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:49 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d7700e-a3bd-49b0-8e8a-c7813f005969]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:49 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3 Jul 18 05:47:49 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:49 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3" returned: 0 in 0.556s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:50 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3 Jul 18 05:47:50 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:50 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b841b31-5218-485f-a830-bbd41b077fb3" returned: 0 in 0.721s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Lock "cinder-quobyte-7b841b31-5218-485f-a830-bbd41b077fb3" released by "delete_volume" :: held 1.348s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:50 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=130,cinder:INSERT=36,cinder:UPDATE=163,cinder:DELETE=8 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:47:50 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Created reservations ['3a5dc9a6-4a3f-4d66-b039-b63a3fed4f33', '6c11bbd1-e6f1-4ba6-8d31-92b3bcc13f6c', '579760cc-41cf-4347-981d-f6eaf06a0699', '6b83fa7f-1634-421f-bdd0-72b7c818bd60'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:51 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:51 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:51 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.416s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:51 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:51 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Deleted volume successfully. Jul 18 05:47:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-158de25d-3927-4362-b89f-738eb5ebc8ac tempest-VolumesActionsTest-896143051 None] Lock "cinder-7b841b31-5218-485f-a830-bbd41b077fb3-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=134,cinder:INSERT=46,cinder:UPDATE=153,cinder:DELETE=18 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (61b6f4e2-7d80-4b62-a0b3-18db0754a526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4bd4d3-85c0-4780-9a17-cdc4782ea686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4bd4d3-85c0-4780-9a17-cdc4782ea686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1890775036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8fde4c-ad9b-49d6-8673-58f58c988b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:53Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd577426-0398-46f8-a0f6-c2443e2647be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd577426-0398-46f8-a0f6-c2443e2647be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28279b17-0d24-4409-bd47-dd41e2855cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28279b17-0d24-4409-bd47-dd41e2855cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8fde4c-ad9b-49d6-8673-58f58c988b20', 'volume_name': 'volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856a5ad2-6200-45f0-8dfe-9d8b5b8623d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856a5ad2-6200-45f0-8dfe-9d8b5b8623d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b91043-777a-495b-8828-705d43021bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:53 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Volume cd8fde4c-ad9b-49d6-8673-58f58c988b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20', 'volume_size': 1} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Flow 'volume_create_manager' (d9b727a2-2b7b-4b1a-8e5e-c15cc623dc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185cb4bc-8081-4d7d-98d6-9d3fd71a4aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185cb4bc-8081-4d7d-98d6-9d3fd71a4aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-584329329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6172e7-0b11-4b9c-8486-1633690abb8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='738b5052a8a34400aef9fadeb9874e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:54Z,use_quota=True,user_id='19a1b6e228804b78a2639f7e605405ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31191934-fe86-437f-8898-6e689a9381fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31191934-fe86-437f-8898-6e689a9381fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1642540-8b8c-4cd0-ac6b-4dffe50b9a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.image.glance [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Creating Keystone auth plugin from conf {{(pid=87497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1642540-8b8c-4cd0-ac6b-4dffe50b9a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee6172e7-0b11-4b9c-8486-1633690abb8f', 'volume_name': 'volume-ee6172e7-0b11-4b9c-8486-1633690abb8f', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259a12c1-7b41-4b95-b4d1-b75b2f52a611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259a12c1-7b41-4b95-b4d1-b75b2f52a611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798a0558-40fa-41cf-809f-cdae676aaac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:54 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Volume ee6172e7-0b11-4b9c-8486-1633690abb8f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee6172e7-0b11-4b9c-8486-1633690abb8f', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Trying to clone ee6172e7-0b11-4b9c-8486-1633690abb8f from image 0d6393c9-e8a0-4628-b021-8c9aa5777656 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]). {{(pid=87497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 05:47:54 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739" returned: 0 in 5.510s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cca1a5-7e36-42e6-9824-8f1e91262590]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:54 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 Jul 18 05:47:54 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 05:47:54 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Image download 20.69 MB at 20.69 MB/s Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[19208baf-0b5a-49eb-b47f-a4d0fea64e11]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:55 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD Jul 18 05:47:55 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:55 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8" returned: 0 in 0.548s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:47:55 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Converted 1024.00 MB image at 185.79 MB/s Jul 18 05:47:55 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 is being set with open permissions: ugo+rw Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:55 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 Jul 18 05:47:55 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:55 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Temporary image 0d6393c9-e8a0-4628-b021-8c9aa5777656 is fetched for user 19a1b6e228804b78a2639f7e605405ec. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9105997-b049-44a1-be74-62d0a095bc20]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:55 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD Jul 18 05:47:55 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:55 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739" returned: 0 in 0.236s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-fef5955d-7557-488d-b2e9-2a63d8547739" released by "_copy_volume_from_snapshot" :: held 7.256s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-3b41a88e-079a-4b49-8441-81270e682dab-fef5955d-7557-488d-b2e9-2a63d8547739" released by "_create_volume_from_snapshot" :: held 7.285s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.304s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1890775036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8fde4c-ad9b-49d6-8673-58f58c988b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:53Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Creating volume cd8fde4c-ad9b-49d6-8673-58f58c988b20 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:55 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:55 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 1073741824 Jul 18 05:47:55 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da51953b-1527-46a7-9549-4283baac59af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef5955d-7557-488d-b2e9-2a63d8547739', 'volume_size': 2, 'snapshot_id': '3b41a88e-079a-4b49-8441-81270e682dab'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad18e21-b297-4a96-9d89-20ee86fc811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:55 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Volume volume-fef5955d-7557-488d-b2e9-2a63d8547739 (fef5955d-7557-488d-b2e9-2a63d8547739): created successfully Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad18e21-b297-4a96-9d89-20ee86fc811c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (9bfe3807-feec-4432-a8d6-a7358f8a841f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b31ce414-0293-40e7-ba2c-6932d9def275 tempest-VolumesSnapshotTestJSON-956399742 None] Created volume successfully. Jul 18 05:47:55 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:55 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 1073741824" returned: 0 in 0.418s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:56 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 Jul 18 05:47:56 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:56 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20" returned: 0 in 0.254s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-584329329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6172e7-0b11-4b9c-8486-1633690abb8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='738b5052a8a34400aef9fadeb9874e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:54Z,use_quota=True,user_id='19a1b6e228804b78a2639f7e605405ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Creating volume ee6172e7-0b11-4b9c-8486-1633690abb8f {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:56 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-fef5955d-7557-488d-b2e9-2a63d8547739-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:56 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f 1073741824 Jul 18 05:47:56 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b91043-777a-495b-8828-705d43021bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea63e2ea-ce63-41c4-ac44-44899c03e3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:56 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Volume volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 (cd8fde4c-ad9b-49d6-8673-58f58c988b20): created successfully Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea63e2ea-ce63-41c4-ac44-44899c03e3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (61b6f4e2-7d80-4b62-a0b3-18db0754a526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-fef5955d-7557-488d-b2e9-2a63d8547739-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9bcf2a42-eb81-4354-9040-d66e73b370ab tempest-VolumesActionsTest-1146653520 None] Created volume successfully. Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-fef5955d-7557-488d-b2e9-2a63d8547739" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-fef5955d-7557-488d-b2e9-2a63d8547739" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a1dec-6aa0-43f9-ae4c-ea1c4fadbfb0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:56 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 Jul 18 05:47:56 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:56 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f 1073741824" returned: 0 in 0.488s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:56 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f Jul 18 05:47:56 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:56 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739" returned: 0 in 0.412s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:56 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739 Jul 18 05:47:56 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:57 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f" returned: 0 in 0.259s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Attempting download of 0d6393c9-e8a0-4628-b021-8c9aa5777656 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}])) to volume ee6172e7-0b11-4b9c-8486-1633690abb8f. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 05:47:57 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd69fcb-6dff-49b2-b360-8ad47ff6d6f4]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_m9wfnv5d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fef5955d-7557-488d-b2e9-2a63d8547739" returned: 0 in 0.285s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-fef5955d-7557-488d-b2e9-2a63d8547739" released by "delete_volume" :: held 0.744s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Created reservations ['546a0211-b0dc-4b5a-9ed4-fe61f96930b4', 'b6a4fbbe-69e9-4582-b13b-ac84b14c5df4', '617deba5-c0fa-4cdb-8bdc-dbbf351b04a0', '1c8e8b4e-bfca-4e5e-b6a6-7312c9813463'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:57 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_m9wfnv5d Jul 18 05:47:57 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:57 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:57 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:57 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_m9wfnv5d" returned: 0 in 0.394s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:57 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_m9wfnv5d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-3b41a88e-079a-4b49-8441-81270e682dab-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.284s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Deleted volume successfully. Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-3b41a88e-079a-4b49-8441-81270e682dab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-184b30e4-a837-4009-92ca-2c1417bf1fb8" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7d6da68b-0393-4212-9e3c-80b2a9258b01 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-fef5955d-7557-488d-b2e9-2a63d8547739-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-184b30e4-a837-4009-92ca-2c1417bf1fb8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-3b41a88e-079a-4b49-8441-81270e682dab" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-3b41a88e-079a-4b49-8441-81270e682dab" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Deleting offline snapshot 3b41a88e-079a-4b49-8441-81270e682dab of volume 184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] snapshot_file for this snap is: volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da993f-bba8-4e5b-9928-639d891cdafa]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:57 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_m9wfnv5d Jul 18 05:47:57 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Acquiring lock "cinder-cd8fde4c-ad9b-49d6-8673-58f58c988b20-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Lock "cinder-cd8fde4c-ad9b-49d6-8673-58f58c988b20-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Acquiring lock "cinder-quobyte-cd8fde4c-ad9b-49d6-8673-58f58c988b20" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Lock "cinder-quobyte-cd8fde4c-ad9b-49d6-8673-58f58c988b20" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:47:57 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab Jul 18 05:47:57 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[480df9fe-f9c4-404c-b9de-50e15af6ed26]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:57 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_m9wfnv5d" returned: 1 in 0.421s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_m9wfnv5d' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9bb476-60f6-42d6-9f36-012ff102c95b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:57 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 Jul 18 05:47:57 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:58 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD Jul 18 05:47:58 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:58 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab" returned: 0 in 0.464s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-184b30e4-a837-4009-92ca-2c1417bf1fb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de2d757-cf57-4102-b4c4-820f02dfc522]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:58 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20" returned: 0 in 0.406s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:58 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20 Jul 18 05:47:58 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:58 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 Jul 18 05:47:58 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:58 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] 0d6393c9-e8a0-4628-b021-8c9aa5777656 was qcow2, converting to qcow2 {{(pid=87497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:58 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f Jul 18 05:47:58 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:58 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cd8fde4c-ad9b-49d6-8673-58f58c988b20" returned: 0 in 0.277s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:58 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Lock "cinder-quobyte-cd8fde4c-ad9b-49d6-8673-58f58c988b20" released by "delete_volume" :: held 0.742s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8" returned: 0 in 0.393s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:58 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab Jul 18 05:47:58 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Created reservations ['c1e53368-e93b-4892-9285-16235e5cc365', 'b887148a-01cb-4429-98d3-9eec95fa170b', '6c38a8e3-56ee-471b-ac7b-0468be513808', '1168d56e-9b6e-4534-920c-0e49d937d530'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:58 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:47:58 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:59 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.323s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:47:59 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Deleted volume successfully. Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab" returned: 0 in 0.499s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:59 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab Jul 18 05:47:59 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1954913f-6ca5-4dec-9694-eb226565fb47 tempest-VolumesActionsTest-896143051 None] Lock "cinder-cd8fde4c-ad9b-49d6-8673-58f58c988b20-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:59 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8.3b41a88e-079a-4b49-8441-81270e682dab" returned: 0 in 0.340s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-3b41a88e-079a-4b49-8441-81270e682dab" released by "_delete_snapshot" :: held 1.814s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-184b30e4-a837-4009-92ca-2c1417bf1fb8" released by "delete_snapshot" :: held 1.844s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (acc8a10d-3a5b-4665-a060-cb2860084989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46ef6c1-812b-443d-bbb8-e0971209af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46ef6c1-812b-443d-bbb8-e0971209af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-417701115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdd0b2a-c0ac-4761-adf0-0d17c34d8925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:59Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daee1b34-99bd-43e5-b5e5-e23739f0eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daee1b34-99bd-43e5-b5e5-e23739f0eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7e0420-d845-42c5-b277-a851f1f44416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7e0420-d845-42c5-b277-a851f1f44416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efdd0b2a-c0ac-4761-adf0-0d17c34d8925', 'volume_name': 'volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7ac679-8e0f-4264-9717-d9cf1d9a2e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7ac679-8e0f-4264-9717-d9cf1d9a2e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e4c0ba-2712-4f33-9f9f-66ba95b0d443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:47:59 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Volume efdd0b2a-c0ac-4761-adf0-0d17c34d8925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925', 'volume_size': 1} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-417701115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdd0b2a-c0ac-4761-adf0-0d17c34d8925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b557bc09ad54c39a4b48a5026d3d073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:47:59Z,use_quota=True,user_id='7617ab9399d54d2ca9b4a4a7668e3d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Creating volume efdd0b2a-c0ac-4761-adf0-0d17c34d8925 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:47:59 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:47:59 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 1073741824 Jul 18 05:47:59 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Created reservations ['03116589-7d05-4fc5-ad9d-0e625e04c41e', '484d21dc-facd-4256-837a-d0d521ffbd94', 'a5afbbcf-0198-4f1d-adc9-462f4b80c23e', '32320469-fb7c-46ef-994a-9b65d1071254'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:47:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Delete snapshot completed successfully. Jul 18 05:47:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5dddc47e-b4b3-4731-bf9a-c9673eeb4459 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-3b41a88e-079a-4b49-8441-81270e682dab-delete_snapshot" released by "delete_snapshot" :: held 2.163s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:00 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 1073741824" returned: 0 in 0.547s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:00 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 Jul 18 05:48:00 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:00 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f" returned: 0 in 1.997s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_j3qrsy3ldevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:48:00 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Converted 112.00 MB image at 56.04 MB/s Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:00 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f 1G Jul 18 05:48:00 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:00 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925" returned: 0 in 0.276s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e4c0ba-2712-4f33-9f9f-66ba95b0d443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de950271-2a41-417b-a0b3-262ef1d83996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:00 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Volume volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 (efdd0b2a-c0ac-4761-adf0-0d17c34d8925): created successfully Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de950271-2a41-417b-a0b3-262ef1d83996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Flow 'volume_create_manager' (acc8a10d-3a5b-4665-a060-cb2860084989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:00 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5578867d-9430-4d62-9dfb-ed1ed449fa79 tempest-VolumesActionsTest-1146653520 None] Created volume successfully. Jul 18 05:48:00 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f 1G" returned: 0 in 0.331s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Downloaded image 0d6393c9-e8a0-4628-b021-8c9aa5777656 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}])) to volume ee6172e7-0b11-4b9c-8486-1633690abb8f successfully. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Temporary image 0d6393c9-e8a0-4628-b021-8c9aa5777656 for user 19a1b6e228804b78a2639f7e605405ec is deleted. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Marking volume ee6172e7-0b11-4b9c-8486-1633690abb8f as bootable. {{(pid=87497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Copying metadata from image 0d6393c9-e8a0-4628-b021-8c9aa5777656 to ee6172e7-0b11-4b9c-8486-1633690abb8f. {{(pid=87497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Creating volume glance metadata for volume ee6172e7-0b11-4b9c-8486-1633690abb8f backed by image 0d6393c9-e8a0-4628-b021-8c9aa5777656 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798a0558-40fa-41cf-809f-cdae676aaac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6172e7-0b11-4b9c-8486-1633690abb8f', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089a82b9-6435-4d65-8b36-d70c10aaaeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:00 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Volume volume-ee6172e7-0b11-4b9c-8486-1633690abb8f (ee6172e7-0b11-4b9c-8486-1633690abb8f): created successfully Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089a82b9-6435-4d65-8b36-d70c10aaaeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Flow 'volume_create_manager' (d9b727a2-2b7b-4b1a-8e5e-c15cc623dc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:00 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5faccfac-ab83-4e73-a8d7-fe6f85187cf6 tempest-VolumesImageMetadata-1306476911 None] Created volume successfully. Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-184b30e4-a837-4009-92ca-2c1417bf1fb8-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-184b30e4-a837-4009-92ca-2c1417bf1fb8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-184b30e4-a837-4009-92ca-2c1417bf1fb8" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-184b30e4-a837-4009-92ca-2c1417bf1fb8" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b4fa15-05a5-4f07-b423-800f38a21f91]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:01 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 Jul 18 05:48:01 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:01 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8" returned: 0 in 0.371s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:01 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8 Jul 18 05:48:01 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Acquiring lock "cinder-ee6172e7-0b11-4b9c-8486-1633690abb8f-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Lock "cinder-ee6172e7-0b11-4b9c-8486-1633690abb8f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:01 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-184b30e4-a837-4009-92ca-2c1417bf1fb8" returned: 0 in 0.286s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-184b30e4-a837-4009-92ca-2c1417bf1fb8" released by "delete_volume" :: held 0.733s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Acquiring lock "cinder-quobyte-ee6172e7-0b11-4b9c-8486-1633690abb8f" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Lock "cinder-quobyte-ee6172e7-0b11-4b9c-8486-1633690abb8f" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b98a93d-b900-4085-9cce-410b169584c1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Created reservations ['5500a365-009a-423a-8f7f-2163deacfef5', '33fa3302-46e3-4ec0-ae58-7330ac4c2a48', '72447671-5db9-492c-8523-c220ff6ede36', '00de7a01-4187-422a-b89d-f12c64b78956'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:01 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f Jul 18 05:48:01 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:01 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:01 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:02 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f" returned: 0 in 0.420s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:02 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.335s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Deleted volume successfully. Jul 18 05:48:02 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f Jul 18 05:48:02 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c557acd3-afa9-4fd0-95e4-2d6a64022c67 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-184b30e4-a837-4009-92ca-2c1417bf1fb8-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "cinder-efdd0b2a-c0ac-4761-adf0-0d17c34d8925-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-efdd0b2a-c0ac-4761-adf0-0d17c34d8925-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "cinder-quobyte-efdd0b2a-c0ac-4761-adf0-0d17c34d8925" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-quobyte-efdd0b2a-c0ac-4761-adf0-0d17c34d8925" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0dd777-2685-48af-bdd0-102e7f8a1cb0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:02 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ee6172e7-0b11-4b9c-8486-1633690abb8f" returned: 0 in 0.330s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Lock "cinder-quobyte-ee6172e7-0b11-4b9c-8486-1633690abb8f" released by "delete_volume" :: held 0.807s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Created reservations ['2bcdc713-3225-43a0-be60-fd6d299c8971', 'aa73d6fd-fd12-4ea3-953e-7db72835c78a', '649ad564-44e4-4e45-ac5b-fe0758a84f8f', 'aeb09521-fd64-4ca9-9142-7cd5c9568d45'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:02 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 Jul 18 05:48:02 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (d90e34d6-f9f2-4bbf-a329-b297edc420d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d498c1-9dd4-4ca0-a679-a8bbe33694de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:02 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:02 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d498c1-9dd4-4ca0-a679-a8bbe33694de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-78790338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bd1543-a8d1-4fe2-9c49-c1c663950ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf1dd2aa7c455ebad35c0c4d7d5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:03Z,use_quota=True,user_id='5e0aff3d9a5240ba9d813b27d71b0a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f123ed-2a9b-45b5-97da-093a3390bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f123ed-2a9b-45b5-97da-093a3390bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8b0a49-ffa8-4235-ba5c-667ff7761786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8b0a49-ffa8-4235-ba5c-667ff7761786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36bd1543-a8d1-4fe2-9c49-c1c663950ce9', 'volume_name': 'volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c50690-5d5b-4fd7-b34a-03f77a4e1324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c50690-5d5b-4fd7-b34a-03f77a4e1324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6770ed-ffa8-4e90-9212-30130ffc0d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:02 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Volume 36bd1543-a8d1-4fe2-9c49-c1c663950ce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9', 'volume_size': 1} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-78790338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bd1543-a8d1-4fe2-9c49-c1c663950ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf1dd2aa7c455ebad35c0c4d7d5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:03Z,use_quota=True,user_id='5e0aff3d9a5240ba9d813b27d71b0a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Creating volume 36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:02 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:02 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 1073741824 Jul 18 05:48:02 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:02 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925" returned: 0 in 0.435s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:02 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925 Jul 18 05:48:02 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:02 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.308s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:02 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:03 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Deleted volume successfully. Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9f228505-2ed9-444b-8b0d-dbdf694c1000 tempest-VolumesImageMetadata-1306476911 None] Lock "cinder-ee6172e7-0b11-4b9c-8486-1633690abb8f-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:03 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-efdd0b2a-c0ac-4761-adf0-0d17c34d8925" returned: 0 in 0.329s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-quobyte-efdd0b2a-c0ac-4761-adf0-0d17c34d8925" released by "delete_volume" :: held 0.827s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Created reservations ['e68a4787-5d2d-466e-bc93-7f3dd285cc83', 'f39e17f3-0421-469f-b28a-537f3d6d72bf', '05424c95-78e9-46b2-80ca-ae528e1255ec', '951a72b0-0ae2-48d5-bbe6-b9831e9e7986'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:03 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 1073741824" returned: 0 in 0.586s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:03 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:03 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:03 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 Jul 18 05:48:03 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:03 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:03 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.410s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6770ed-ffa8-4e90-9212-30130ffc0d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303bfaed-30a1-43ec-b742-478a3896bd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:03 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Deleted volume successfully. Jul 18 05:48:03 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Volume volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 (36bd1543-a8d1-4fe2-9c49-c1c663950ce9): created successfully Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303bfaed-30a1-43ec-b742-478a3896bd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (d90e34d6-f9f2-4bbf-a329-b297edc420d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cd824644-e714-457e-a28d-bc2f33d75892 tempest-VolumesActionsTest-1146653520 None] Lock "cinder-efdd0b2a-c0ac-4761-adf0-0d17c34d8925-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:03 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ee9142f3-8c43-47b6-8b20-66b688b78155 tempest-VolumesSnapshotTestJSON-956399742 None] Created volume successfully. Jul 18 05:48:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Creating offline snapshot c0a1d56d-879f-45d4-a17c-39fc29c0a956 of volume 36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:48:04 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbefc80-a249-46c9-ada5-26938ac95ab0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:05 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 Jul 18 05:48:05 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:05 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" returned: 0 in 0.439s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:05 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 1G Jul 18 05:48:05 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:05 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 1G" returned: 0 in 0.574s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:06 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 Jul 18 05:48:06 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:06 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:06 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:06 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956" returned: 0 in 0.389s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:06 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 is being set with open permissions: ugo+rw Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:06 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 Jul 18 05:48:06 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Flow 'volume_create_manager' (ea5444ca-5170-43fe-91be-79c337c8d52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b85d31c-6051-49ef-a1a3-782689a92913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b85d31c-6051-49ef-a1a3-782689a92913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1664841004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a80ab5-f782-4fe4-a85d-4eb636dee261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0962b9bc13854c5f967b667c0e6ea021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:06Z,use_quota=True,user_id='cbec574652fa4a5eab0569eb4bbc806e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f37e9de-69b9-42f2-ad90-41f4919837eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:06 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f37e9de-69b9-42f2-ad90-41f4919837eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7d12ab-9b44-4e79-9cff-1697ad7438e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7d12ab-9b44-4e79-9cff-1697ad7438e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a80ab5-f782-4fe4-a85d-4eb636dee261', 'volume_name': 'volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f29ada-0942-4836-9dd8-3c5c08f53f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f29ada-0942-4836-9dd8-3c5c08f53f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff16dff6-44f1-4c67-a6ff-89b85071c101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:06 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Volume c5a80ab5-f782-4fe4-a85d-4eb636dee261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261', 'volume_size': 1} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.366s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:48:06 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956" returned: 0 in 0.321s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:06 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.info Jul 18 05:48:06 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:07 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.info" returned: 0 in 0.303s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:07 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.info is being set with open permissions: ugo+rw Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:07 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.info Jul 18 05:48:07 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:07 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.info" returned: 0 in 0.323s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1664841004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a80ab5-f782-4fe4-a85d-4eb636dee261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0962b9bc13854c5f967b667c0e6ea021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:06Z,use_quota=True,user_id='cbec574652fa4a5eab0569eb4bbc806e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Creating volume c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:07 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:07 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 1073741824 Jul 18 05:48:07 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:07 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-174fb8af-99b5-46fa-afcc-6f9b9218e352 tempest-VolumesSnapshotTestJSON-956399742 None] Create snapshot completed successfully Jul 18 05:48:07 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 1073741824" returned: 0 in 0.501s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:07 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 Jul 18 05:48:07 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:08 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff16dff6-44f1-4c67-a6ff-89b85071c101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb078c4-672b-4459-b7e7-b73c020c6faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:08 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Volume volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 (c5a80ab5-f782-4fe4-a85d-4eb636dee261): created successfully Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb078c4-672b-4459-b7e7-b73c020c6faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Flow 'volume_create_manager' (ea5444ca-5170-43fe-91be-79c337c8d52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:08 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ac8f81de-e075-4c89-9f35-b60475266ae7 tempest-VolumesDeleteCascade-1430085704 None] Created volume successfully. Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (97ae7e5a-6c21-48f2-8877-fd0e62deb219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7377539e-5390-4463-bc2e-929b881e2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7377539e-5390-4463-bc2e-929b881e2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-690289400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979acff3-9710-4913-8b7a-c8a16c6e2bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf1dd2aa7c455ebad35c0c4d7d5fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0a1d56d-879f-45d4-a17c-39fc29c0a956,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:09Z,use_quota=True,user_id='5e0aff3d9a5240ba9d813b27d71b0a04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab5457c-9bfd-495b-9404-7935f11657d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab5457c-9bfd-495b-9404-7935f11657d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00591208-b09f-457c-bc79-9e4d06bc2119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00591208-b09f-457c-bc79-9e4d06bc2119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '979acff3-9710-4913-8b7a-c8a16c6e2bdf', 'volume_name': 'volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf', 'volume_size': 1, 'snapshot_id': 'c0a1d56d-879f-45d4-a17c-39fc29c0a956'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287497c7-9590-4580-8b78-2651236720f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287497c7-9590-4580-8b78-2651236720f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b37653-f27b-47dc-8c56-679499dc1230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:08 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Volume 979acff3-9710-4913-8b7a-c8a16c6e2bdf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf', 'volume_size': 1, 'snapshot_id': 'c0a1d56d-879f-45d4-a17c-39fc29c0a956'} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Creating offline snapshot 3ff86c91-29d1-4fb8-a566-6d7d8102e320 of volume c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ee593d-d4da-4fb3-baed-276f8aa6f560]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:09 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 Jul 18 05:48:09 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:09 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261" returned: 0 in 0.418s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:09 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 1G Jul 18 05:48:09 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:09 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 1G" returned: 0 in 0.521s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:09 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 Jul 18 05:48:09 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:10 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320" returned: 0 in 0.325s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:10 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 is being set with open permissions: ugo+rw Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:10 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 Jul 18 05:48:10 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:10 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320" returned: 0 in 0.266s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:10 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.info Jul 18 05:48:10 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:10 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.info" returned: 0 in 0.252s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:10 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.info is being set with open permissions: ugo+rw Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:10 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.info Jul 18 05:48:10 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:10 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.info" returned: 0 in 0.247s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.126s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-c0a1d56d-879f-45d4-a17c-39fc29c0a956-979acff3-9710-4913-8b7a-c8a16c6e2bdf" by "_create_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-c0a1d56d-879f-45d4-a17c-39fc29c0a956-979acff3-9710-4913-8b7a-c8a16c6e2bdf" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Creating volume 979acff3-9710-4913-8b7a-c8a16c6e2bdf from snapshot c0a1d56d-879f-45d4-a17c-39fc29c0a956 {{(pid=87497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-979acff3-9710-4913-8b7a-c8a16c6e2bdf" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:11 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e9dc2dfe-52c6-4159-a34c-a2926c5cc731 tempest-VolumesDeleteCascade-1430085704 None] Create snapshot completed successfully Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-979acff3-9710-4913-8b7a-c8a16c6e2bdf" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] snapshot: c0a1d56d-879f-45d4-a17c-39fc29c0a956, volume: 979acff3-9710-4913-8b7a-c8a16c6e2bdf, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23af302-e879-4fa6-8fc1-8ec165e55309]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:11 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 Jul 18 05:48:11 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:11 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956" returned: 0 in 0.375s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5109901e-9106-4be5-8e38-d1cb8e5a12d3]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:11 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 Jul 18 05:48:11 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:11 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" returned: 0 in 0.443s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:48:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:12 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf Jul 18 05:48:12 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:16 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf" returned: 0 in 4.900s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:16 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e729f-e798-4993-8a18-3495fe4ae8f7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:17 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 Jul 18 05:48:17 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:17 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" returned: 0 in 0.530s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:48:17 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Converted 1024.00 MB image at 208.96 MB/s Jul 18 05:48:17 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf is being set with open permissions: ugo+rw Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:17 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf Jul 18 05:48:17 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:17 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-979acff3-9710-4913-8b7a-c8a16c6e2bdf" released by "_copy_volume_from_snapshot" :: held 6.616s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-c0a1d56d-879f-45d4-a17c-39fc29c0a956-979acff3-9710-4913-8b7a-c8a16c6e2bdf" released by "_create_volume_from_snapshot" :: held 6.657s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.707s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.594s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Creating offline snapshot 0b269f44-7640-4e14-b905-f8f31125f4c0 of volume c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dee6b7e-2fbc-49c5-8ea6-1e473ff41c0e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b37653-f27b-47dc-8c56-679499dc1230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf', 'volume_size': 1, 'snapshot_id': 'c0a1d56d-879f-45d4-a17c-39fc29c0a956'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbecad6e-55fa-4ec4-ab95-fff69b1bfdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Volume volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf (979acff3-9710-4913-8b7a-c8a16c6e2bdf): created successfully Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbecad6e-55fa-4ec4-ab95-fff69b1bfdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Flow 'volume_create_manager' (97ae7e5a-6c21-48f2-8877-fd0e62deb219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:17 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-bfc9ec29-d058-410d-b79d-3d3d3c9121ee tempest-VolumesSnapshotTestJSON-956399742 None] Created volume successfully. Jul 18 05:48:17 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 Jul 18 05:48:17 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:18 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320" returned: 0 in 0.384s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:18 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 1G Jul 18 05:48:18 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:18 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 1G" returned: 0 in 0.481s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:18 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 Jul 18 05:48:18 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-979acff3-9710-4913-8b7a-c8a16c6e2bdf-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-979acff3-9710-4913-8b7a-c8a16c6e2bdf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-979acff3-9710-4913-8b7a-c8a16c6e2bdf" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Flow 'volume_create_manager' (43a17728-8e81-4802-8558-2ea7d09ebace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2dc5af-bb52-4c49-9f6d-8ad9153f9f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2dc5af-bb52-4c49-9f6d-8ad9153f9f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-521381824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b931ec5-d677-4ee5-91ad-e9d022611a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91c5dbd969c4fb39adc10c4680c1dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:19Z,use_quota=True,user_id='d23aa2f8600a45de8c64f09c129a19f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90956b8-50d8-40c3-9abb-c9d922657174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90956b8-50d8-40c3-9abb-c9d922657174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4023bfa3-7640-4b54-9e1d-b07cf434a4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4023bfa3-7640-4b54-9e1d-b07cf434a4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b931ec5-d677-4ee5-91ad-e9d022611a37', 'volume_name': 'volume-1b931ec5-d677-4ee5-91ad-e9d022611a37', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64043141-9160-40ae-97a7-455ab06f718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64043141-9160-40ae-97a7-455ab06f718d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2765e2a2-2a5b-49c2-89e1-22e73a9dc6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Volume 1b931ec5-d677-4ee5-91ad-e9d022611a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b931ec5-d677-4ee5-91ad-e9d022611a37', 'volume_size': 1} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-979acff3-9710-4913-8b7a-c8a16c6e2bdf" acquired by "delete_volume" :: waited 0.100s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd6b23e-6945-4333-a788-eb6a35c1a281]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:19 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0" returned: 0 in 0.380s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:19 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 is being set with open permissions: ugo+rw Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:19 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 Jul 18 05:48:19 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:19 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf Jul 18 05:48:19 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:19 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0" returned: 0 in 0.241s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.587s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-521381824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b931ec5-d677-4ee5-91ad-e9d022611a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91c5dbd969c4fb39adc10c4680c1dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:19Z,use_quota=True,user_id='d23aa2f8600a45de8c64f09c129a19f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Creating volume 1b931ec5-d677-4ee5-91ad-e9d022611a37 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:19 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:19 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 1073741824 Jul 18 05:48:19 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f8c69e3d-f1be-46c1-adc6-55187cdba14c tempest-VolumesDeleteCascade-1430085704 None] Create snapshot completed successfully Jul 18 05:48:19 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf" returned: 0 in 0.374s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:19 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf Jul 18 05:48:19 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:19 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-c5a80ab5-f782-4fe4-a85d-4eb636dee261-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-979acff3-9710-4913-8b7a-c8a16c6e2bdf" returned: 0 in 0.275s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-979acff3-9710-4913-8b7a-c8a16c6e2bdf" released by "delete_volume" :: held 0.703s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-c5a80ab5-f782-4fe4-a85d-4eb636dee261-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Performing cascade delete. {{(pid=87497) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-0b269f44-7640-4e14-b905-f8f31125f4c0-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Created reservations ['df380586-c944-4c7f-97cc-888449e288ee', 'cd267d85-3844-465c-b795-e5be93a0846f', '70b374c7-74cb-4958-ad5c-b105d20a1c71', '126d7ebf-f986-4f6a-a592-0fc6dd491704'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-0b269f44-7640-4e14-b905-f8f31125f4c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-c5a80ab5-f782-4fe4-a85d-4eb636dee261" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:19 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 1073741824" returned: 0 in 0.523s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-c5a80ab5-f782-4fe4-a85d-4eb636dee261" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-0b269f44-7640-4e14-b905-f8f31125f4c0" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-0b269f44-7640-4e14-b905-f8f31125f4c0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Deleting offline snapshot 0b269f44-7640-4e14-b905-f8f31125f4c0 of volume c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] snapshot_file for this snap is: volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd8cf2c-c6be-4d10-a891-176bc7d36b08]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:19 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:19 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:19 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:19 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-c0a1d56d-879f-45d4-a17c-39fc29c0a956-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-c0a1d56d-879f-45d4-a17c-39fc29c0a956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:20 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 Jul 18 05:48:20 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-c0a1d56d-879f-45d4-a17c-39fc29c0a956" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-c0a1d56d-879f-45d4-a17c-39fc29c0a956" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Deleting offline snapshot c0a1d56d-879f-45d4-a17c-39fc29c0a956 of volume 36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] snapshot_file for this snap is: volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce35cf-7588-4e96-bb54-26e47850fdd6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:20 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37" returned: 0 in 0.308s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2765e2a2-2a5b-49c2-89e1-22e73a9dc6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b931ec5-d677-4ee5-91ad-e9d022611a37', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25764cff-6a8e-4eab-9850-90c6f4635ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:20 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Volume volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 (1b931ec5-d677-4ee5-91ad-e9d022611a37): created successfully Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25764cff-6a8e-4eab-9850-90c6f4635ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Flow 'volume_create_manager' (43a17728-8e81-4802-8558-2ea7d09ebace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8ca8bd7d-0b6e-4a7c-ab3e-47af44874e55 tempest-VolumesListAdminTestJSON-992352810 None] Created volume successfully. Jul 18 05:48:20 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.340s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Deleted volume successfully. Jul 18 05:48:20 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6aafd4b4-dcd3-4269-8e9b-2eb822fb9f2b tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-979acff3-9710-4913-8b7a-c8a16c6e2bdf-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:20 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:20 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0" returned: 0 in 0.464s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca74db03-a7eb-4eec-9e93-4edff6c718c2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:20 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 Jul 18 05:48:20 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:20 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956" returned: 0 in 0.409s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e6f797-e3df-45dc-82a9-04bdfa55b7e9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:20 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 Jul 18 05:48:20 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:20 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320" returned: 0 in 0.423s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:20 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 Jul 18 05:48:20 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:21 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" returned: 0 in 0.396s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:21 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 Jul 18 05:48:21 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:21 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0" returned: 0 in 0.460s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:21 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0 Jul 18 05:48:21 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:21 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956" returned: 0 in 0.440s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:21 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956 Jul 18 05:48:21 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Flow 'volume_create_manager' (9670456f-ddc6-4ee6-8523-17c6b235a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e23b0d0-ef17-4908-b681-5c01f695e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e23b0d0-ef17-4908-b681-5c01f695e424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-857517626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e482c91c-80bf-43cb-baf1-ac32f0eb9b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91c5dbd969c4fb39adc10c4680c1dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:21Z,use_quota=True,user_id='d23aa2f8600a45de8c64f09c129a19f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e52e9e9-73f2-41a6-b7b7-aeab5ab6eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e52e9e9-73f2-41a6-b7b7-aeab5ab6eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d31695c-1119-4182-9e0a-e8d49397a231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d31695c-1119-4182-9e0a-e8d49397a231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e482c91c-80bf-43cb-baf1-ac32f0eb9b06', 'volume_name': 'volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:21 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bf49a0-58fc-448d-864b-d26bfab2f498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bf49a0-58fc-448d-864b-d26bfab2f498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28267add-28f0-41e8-a05e-c3f2394f191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Volume e482c91c-80bf-43cb-baf1-ac32f0eb9b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06', 'volume_size': 1} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-857517626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e482c91c-80bf-43cb-baf1-ac32f0eb9b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91c5dbd969c4fb39adc10c4680c1dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:21Z,use_quota=True,user_id='d23aa2f8600a45de8c64f09c129a19f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Creating volume e482c91c-80bf-43cb-baf1-ac32f0eb9b06 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:21 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.0b269f44-7640-4e14-b905-f8f31125f4c0" returned: 0 in 0.309s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:21 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 1073741824 Jul 18 05:48:21 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-0b269f44-7640-4e14-b905-f8f31125f4c0" released by "_delete_snapshot" :: held 1.787s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-c5a80ab5-f782-4fe4-a85d-4eb636dee261" released by "delete_snapshot" :: held 1.817s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Created reservations ['0c34333f-41bf-4f33-a7fa-7aa5b6e70ff7', '7752a9b5-786f-4e3a-bc0c-2305216e8b0a', '80cb50f2-9a9f-4251-93aa-f67260fc623f', '4c4c595b-4dee-4280-a71e-3cc674c3c556'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:21 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9.c0a1d56d-879f-45d4-a17c-39fc29c0a956" returned: 0 in 0.280s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-c0a1d56d-879f-45d4-a17c-39fc29c0a956" released by "_delete_snapshot" :: held 1.645s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" released by "delete_snapshot" :: held 1.677s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Delete snapshot completed successfully. Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-0b269f44-7640-4e14-b905-f8f31125f4c0-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-3ff86c91-29d1-4fb8-a566-6d7d8102e320-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-3ff86c91-29d1-4fb8-a566-6d7d8102e320-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Created reservations ['ce531722-39a7-4518-90cd-ed011a709462', 'd6626c82-c643-47aa-949f-403beab2af09', '12b3ab53-9467-4e3f-adbf-27f5f22ea2ba', 'e6bda275-e5f6-4106-8e06-f533d0a6ab1c'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-c5a80ab5-f782-4fe4-a85d-4eb636dee261" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-c5a80ab5-f782-4fe4-a85d-4eb636dee261" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-3ff86c91-29d1-4fb8-a566-6d7d8102e320" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-3ff86c91-29d1-4fb8-a566-6d7d8102e320" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Deleting offline snapshot 3ff86c91-29d1-4fb8-a566-6d7d8102e320 of volume c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] snapshot_file for this snap is: volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5415007a-0fa5-40b5-9443-4d26c3dbb426]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Delete snapshot completed successfully. Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d3937287-e9de-46a7-8c81-7fad79dad896 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-c0a1d56d-879f-45d4-a17c-39fc29c0a956-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:22 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 1073741824" returned: 0 in 0.502s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:22 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 Jul 18 05:48:22 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:22 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 Jul 18 05:48:22 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-36bd1543-a8d1-4fe2-9c49-c1c663950ce9-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-36bd1543-a8d1-4fe2-9c49-c1c663950ce9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:22 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320" returned: 0 in 0.443s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" acquired by "delete_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:22 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f15e21c-3483-43c0-a35e-9a8678ae3f7c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06" returned: 0 in 0.355s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c09b7a-9898-4945-98ca-042612f54c70]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28267add-28f0-41e8-a05e-c3f2394f191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1a9d2e-99d6-4e7e-bd07-928a7c624788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:22 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Volume volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 (e482c91c-80bf-43cb-baf1-ac32f0eb9b06): created successfully Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1a9d2e-99d6-4e7e-bd07-928a7c624788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Flow 'volume_create_manager' (9670456f-ddc6-4ee6-8523-17c6b235a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0654c5d9-6693-41dd-983d-65ac639a8696 tempest-VolumesListAdminTestJSON-992352810 None] Created volume successfully. Jul 18 05:48:22 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 Jul 18 05:48:22 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:22 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 Jul 18 05:48:22 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:22 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261" returned: 0 in 0.381s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:22 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" returned: 0 in 0.376s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:22 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 Jul 18 05:48:22 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:22 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9 Jul 18 05:48:22 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:23 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" returned: 0 in 0.293s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-36bd1543-a8d1-4fe2-9c49-c1c663950ce9" released by "delete_volume" :: held 0.735s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:23 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320" returned: 0 in 0.340s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:23 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320 Jul 18 05:48:23 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Created reservations ['9578ac3d-fdcd-43d4-ae09-41adce2fb102', '62f094c4-3935-4a70-a762-0850df1ca22d', '677f778b-83c0-4550-81d8-781d07b8b5af', 'db894ad2-87f1-4815-bb12-98af84ebff22'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:23 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:23 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:23 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261.3ff86c91-29d1-4fb8-a566-6d7d8102e320" returned: 0 in 0.279s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-3ff86c91-29d1-4fb8-a566-6d7d8102e320" released by "_delete_snapshot" :: held 1.599s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-c5a80ab5-f782-4fe4-a85d-4eb636dee261" released by "delete_snapshot" :: held 1.631s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:23 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.311s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Created reservations ['6b5de5d7-1601-4208-9910-4c1d6c8a4337', '283b4c91-33f7-4f0b-bbaf-848733e8b557', 'b0a62d17-5a7f-4a25-b49c-898f371d82df', 'b5deebfb-561c-463b-8dee-015abcf57f25'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:23 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Deleted volume successfully. Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-b2c0aed1-d2c4-4046-ba89-69af162f02ff-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-effa25bd-ec68-445e-a022-9c4bc506667c tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-36bd1543-a8d1-4fe2-9c49-c1c663950ce9-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-b2c0aed1-d2c4-4046-ba89-69af162f02ff-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:23 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Delete snapshot completed successfully. Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "cinder-quobyte-b2c0aed1-d2c4-4046-ba89-69af162f02ff" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-3ff86c91-29d1-4fb8-a566-6d7d8102e320-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Snapshots deleted, issuing volume delete {{(pid=87497) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-c5a80ab5-f782-4fe4-a85d-4eb636dee261" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-b2c0aed1-d2c4-4046-ba89-69af162f02ff" acquired by "delete_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-c5a80ab5-f782-4fe4-a85d-4eb636dee261" acquired by "delete_volume" :: waited 0.056s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19649c6-7c0f-42bc-a8c1-86f5f97a7982]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[467de200-76f5-4563-b87d-240543596c56]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:23 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff Jul 18 05:48:23 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:24 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 Jul 18 05:48:24 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Flow 'volume_create_manager' (f5a43d8c-4ef6-495f-9570-ea565567e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b701392-d95c-423e-b814-71b7fe79af1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b701392-d95c-423e-b814-71b7fe79af1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-382880339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4056f8ad-23fa-4f60-b7ce-25953b57c31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91c5dbd969c4fb39adc10c4680c1dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:24Z,use_quota=True,user_id='d23aa2f8600a45de8c64f09c129a19f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98a251c-2928-4068-bc24-580dc6e74f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98a251c-2928-4068-bc24-580dc6e74f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90b7ba6-b88e-4382-b126-fa101605eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90b7ba6-b88e-4382-b126-fa101605eb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4056f8ad-23fa-4f60-b7ce-25953b57c31a', 'volume_name': 'volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34036e32-d55a-4b3e-afd5-ece8c5bf8dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34036e32-d55a-4b3e-afd5-ece8c5bf8dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49ebe52-b4f9-4a8b-b5d0-648fbe702b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:24 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Volume 4056f8ad-23fa-4f60-b7ce-25953b57c31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a', 'volume_size': 1} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-382880339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4056f8ad-23fa-4f60-b7ce-25953b57c31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91c5dbd969c4fb39adc10c4680c1dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:24Z,use_quota=True,user_id='d23aa2f8600a45de8c64f09c129a19f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Creating volume 4056f8ad-23fa-4f60-b7ce-25953b57c31a {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:24 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:24 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff" returned: 0 in 0.412s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:24 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a 1073741824 Jul 18 05:48:24 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:24 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff Jul 18 05:48:24 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:24 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261" returned: 0 in 0.459s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:24 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261 Jul 18 05:48:24 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:24 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b2c0aed1-d2c4-4046-ba89-69af162f02ff" returned: 0 in 0.267s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-quobyte-b2c0aed1-d2c4-4046-ba89-69af162f02ff" released by "delete_volume" :: held 0.771s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Created reservations ['8830bf06-a812-4fe8-adfc-77523f7708fc', '38deff2b-5ccb-4e52-9542-4ea306c106ea', 'c86d50ff-9028-49e2-8f08-a77901954c40', '4bb04912-8c89-49ef-ade5-06c2f8143559'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:24 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5a80ab5-f782-4fe4-a85d-4eb636dee261" returned: 0 in 0.281s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-c5a80ab5-f782-4fe4-a85d-4eb636dee261" released by "delete_volume" :: held 0.820s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:24 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a 1073741824" returned: 0 in 0.486s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Created reservations ['dc1572ea-05eb-470e-b59e-768ba2e2a952', '6ccb9740-b91a-45ff-82b0-04d7906231f2', 'a3b7b4e6-98bf-42c2-8d4d-feeefbc96861', '6100e027-8e15-48e9-932e-cc83abe8ce95'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:24 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:24 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:24 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a Jul 18 05:48:24 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:24 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:24 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:25 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.302s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:25 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Deleted volume successfully. Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-aa2643f3-331a-435a-a499-d5979b877a35 tempest-VolumesSnapshotTestJSON-956399742 None] Lock "cinder-b2c0aed1-d2c4-4046-ba89-69af162f02ff-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:25 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a" returned: 0 in 0.324s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49ebe52-b4f9-4a8b-b5d0-648fbe702b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d1d883-7136-4195-a158-6a42a4577de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:25 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Volume volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a (4056f8ad-23fa-4f60-b7ce-25953b57c31a): created successfully Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d1d883-7136-4195-a158-6a42a4577de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Flow 'volume_create_manager' (f5a43d8c-4ef6-495f-9570-ea565567e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:25 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-16ba0ed1-e1cd-4805-8df8-226803896741 tempest-VolumesListAdminTestJSON-992352810 None] Created volume successfully. Jul 18 05:48:25 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.379s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:25 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Deleted volume successfully. Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7af399c7-6665-491f-a2ca-d69dbb52b6d0 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-c5a80ab5-f782-4fe4-a85d-4eb636dee261-delete_volume" released by "delete_volume" :: held 5.577s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Flow 'volume_create_manager' (885d6965-88fa-4d56-ae15-8a58d90387a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1680a0a7-412a-4fbe-9639-ba1c3a42be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1680a0a7-412a-4fbe-9639-ba1c3a42be60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1561911942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc8825c-368a-4b64-ae3a-6f9a96bc8f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0962b9bc13854c5f967b667c0e6ea021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:26Z,use_quota=True,user_id='cbec574652fa4a5eab0569eb4bbc806e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb10806-c7a7-41bd-a9fe-4b34de0f3f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb10806-c7a7-41bd-a9fe-4b34de0f3f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7699770-6f42-4ce5-bac1-2594882a323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7699770-6f42-4ce5-bac1-2594882a323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc8825c-368a-4b64-ae3a-6f9a96bc8f30', 'volume_name': 'volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e71489-21a9-4bf5-90e3-5240660f58f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e71489-21a9-4bf5-90e3-5240660f58f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d12118-404f-44e4-94f1-70f81e0cab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:26 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Volume bcc8825c-368a-4b64-ae3a-6f9a96bc8f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30', 'volume_size': 1} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1561911942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc8825c-368a-4b64-ae3a-6f9a96bc8f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0962b9bc13854c5f967b667c0e6ea021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:26Z,use_quota=True,user_id='cbec574652fa4a5eab0569eb4bbc806e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Creating volume bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:26 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:26 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 1073741824 Jul 18 05:48:26 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:26 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 1073741824" returned: 0 in 0.495s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:26 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 Jul 18 05:48:26 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:26 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" returned: 0 in 0.310s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d12118-404f-44e4-94f1-70f81e0cab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9487af27-2170-4ee1-a8e6-e6b3a3fdef40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:26 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Volume volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 (bcc8825c-368a-4b64-ae3a-6f9a96bc8f30): created successfully Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9487af27-2170-4ee1-a8e6-e6b3a3fdef40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Flow 'volume_create_manager' (885d6965-88fa-4d56-ae15-8a58d90387a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e54e4e4b-a615-4304-a0ca-d03e655e5625 tempest-VolumesDeleteCascade-1430085704 None] Created volume successfully. Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Flow 'volume_create_manager' (4ad7d16a-348a-464c-aefa-927c3193439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c522752-99ff-48cf-8f70-f9a31b972c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c522752-99ff-48cf-8f70-f9a31b972c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e487fb-773f-4346-bdf5-7508939d7fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca6dafeb84f4355b1172383a591c342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:27Z,use_quota=True,user_id='659062842d1b4a8ea2746598928fcb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aeaf1b8-9e08-4d2e-9dbf-b13803a40be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aeaf1b8-9e08-4d2e-9dbf-b13803a40be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c69230-58cb-4bbb-945b-57e9ba5d6276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c69230-58cb-4bbb-945b-57e9ba5d6276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e487fb-773f-4346-bdf5-7508939d7fb6', 'volume_name': 'volume-47e487fb-773f-4346-bdf5-7508939d7fb6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768df613-fcb9-4569-93ae-87ed5191632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768df613-fcb9-4569-93ae-87ed5191632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbebbe1-774d-4057-a413-83dbddf269be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:27 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Volume 47e487fb-773f-4346-bdf5-7508939d7fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e487fb-773f-4346-bdf5-7508939d7fb6', 'volume_size': 1} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e487fb-773f-4346-bdf5-7508939d7fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca6dafeb84f4355b1172383a591c342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:27Z,use_quota=True,user_id='659062842d1b4a8ea2746598928fcb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Creating volume 47e487fb-773f-4346-bdf5-7508939d7fb6 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:27 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:27 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6 1073741824 Jul 18 05:48:27 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:27 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6 1073741824" returned: 0 in 0.466s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:27 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6 Jul 18 05:48:27 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:27 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6" returned: 0 in 0.254s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbebbe1-774d-4057-a413-83dbddf269be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e487fb-773f-4346-bdf5-7508939d7fb6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5751f0d-facc-4857-b6fd-f1039d72ae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:27 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Volume volume-47e487fb-773f-4346-bdf5-7508939d7fb6 (47e487fb-773f-4346-bdf5-7508939d7fb6): created successfully Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5751f0d-facc-4857-b6fd-f1039d72ae44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Flow 'volume_create_manager' (4ad7d16a-348a-464c-aefa-927c3193439c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:27 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c6902152-8177-4f50-989e-cc9a94e3490e tempest-VolumesListAdminTestJSON-889325781 None] Created volume successfully. Jul 18 05:48:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Creating offline snapshot dbc77e3a-c92c-4026-b239-f52e018b50ef of volume bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:48:28 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f033c62f-15e0-4c1d-8861-386622a6f618]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:28 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 Jul 18 05:48:28 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:28 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" returned: 0 in 0.386s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:28 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef 1G Jul 18 05:48:28 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:29 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef 1G" returned: 0 in 0.502s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Acquiring lock "cinder-47e487fb-773f-4346-bdf5-7508939d7fb6-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:29 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef Jul 18 05:48:29 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Lock "cinder-47e487fb-773f-4346-bdf5-7508939d7fb6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Acquiring lock "cinder-quobyte-47e487fb-773f-4346-bdf5-7508939d7fb6" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Lock "cinder-quobyte-47e487fb-773f-4346-bdf5-7508939d7fb6" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a40923-1bd9-414d-8c98-a375cac4df67]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "cinder-4056f8ad-23fa-4f60-b7ce-25953b57c31a-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-4056f8ad-23fa-4f60-b7ce-25953b57c31a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "cinder-quobyte-4056f8ad-23fa-4f60-b7ce-25953b57c31a" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-quobyte-4056f8ad-23fa-4f60-b7ce-25953b57c31a" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:29 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6 Jul 18 05:48:29 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb381823-b23b-447a-9040-b90d3bf5b6aa]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:29 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef" returned: 0 in 0.432s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:29 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef is being set with open permissions: ugo+rw Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:29 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef Jul 18 05:48:29 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:29 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a Jul 18 05:48:29 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:29 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6" returned: 0 in 0.524s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:29 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6 Jul 18 05:48:29 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:29 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef" returned: 0 in 0.317s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:30 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.info Jul 18 05:48:30 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:30 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a" returned: 0 in 0.531s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:30 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a Jul 18 05:48:30 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:30 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47e487fb-773f-4346-bdf5-7508939d7fb6" returned: 0 in 0.325s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Lock "cinder-quobyte-47e487fb-773f-4346-bdf5-7508939d7fb6" released by "delete_volume" :: held 0.911s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Created reservations ['186d1da2-a222-4c25-a161-b10aca7f5494', 'd815050e-2cbb-4470-961f-6b8adb06b295', 'a69ad61a-cadd-4cca-bcdf-72ff2bd7248c', '71f5b701-e3b7-4905-b5f0-437ca23bb5e9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:30 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.info" returned: 0 in 0.334s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:30 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.info is being set with open permissions: ugo+rw Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:30 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:30 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.info Jul 18 05:48:30 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4056f8ad-23fa-4f60-b7ce-25953b57c31a" returned: 0 in 0.308s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-quobyte-4056f8ad-23fa-4f60-b7ce-25953b57c31a" released by "delete_volume" :: held 0.910s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:30 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:30 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Created reservations ['6577c7b3-8aaf-4102-90e8-b2574dbec9bf', 'e00ee57b-27d2-4045-a89e-f2695bdab973', 'b359520a-d1a7-4a14-8362-2389d61bebfa', 'dbaae377-77ce-4928-83f5-d8278589b839'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:30 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:30 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:30 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.310s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:30 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.info" returned: 0 in 0.389s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Deleted volume successfully. Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "cinder-e482c91c-80bf-43cb-baf1-ac32f0eb9b06-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-e482c91c-80bf-43cb-baf1-ac32f0eb9b06-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9de6473e-fa18-4233-a07d-f66c54c77285 tempest-VolumesDeleteCascade-1430085704 None] Create snapshot completed successfully Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9a4ba015-b1e8-4606-bdef-ab70710b2573 tempest-VolumesListAdminTestJSON-889325781 None] Lock "cinder-47e487fb-773f-4346-bdf5-7508939d7fb6-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "cinder-quobyte-e482c91c-80bf-43cb-baf1-ac32f0eb9b06" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-quobyte-e482c91c-80bf-43cb-baf1-ac32f0eb9b06" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16528ff-4e20-4ec6-815b-54ab61b0e2dc]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:30 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.361s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Deleted volume successfully. Jul 18 05:48:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-08348ec6-42ce-41af-ad04-13b5fb005647 tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-4056f8ad-23fa-4f60-b7ce-25953b57c31a-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:31 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 Jul 18 05:48:31 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:31 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06" returned: 0 in 0.376s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:31 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06 Jul 18 05:48:31 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:31 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e482c91c-80bf-43cb-baf1-ac32f0eb9b06" returned: 0 in 0.266s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-quobyte-e482c91c-80bf-43cb-baf1-ac32f0eb9b06" released by "delete_volume" :: held 0.695s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Created reservations ['a3f6f267-ca5a-4987-8a26-9871c6524c91', '68b4ac0d-1b90-4a44-ab16-41e74dd30d98', '4bfc4344-4f88-446e-96c5-ba6b4d715a28', 'dd53c4f2-907d-49dd-9633-3f3efcbddb79'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:31 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:31 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "cinder-1b931ec5-d677-4ee5-91ad-e9d022611a37-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-1b931ec5-d677-4ee5-91ad-e9d022611a37-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "cinder-quobyte-1b931ec5-d677-4ee5-91ad-e9d022611a37" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-quobyte-1b931ec5-d677-4ee5-91ad-e9d022611a37" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:32 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.322s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Deleted volume successfully. Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cfee4a-2b35-4287-b334-2f0ac33465e9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eab620ab-4ced-4df4-963c-ee5aa1e85d5f tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-e482c91c-80bf-43cb-baf1-ac32f0eb9b06-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Flow 'volume_create_manager' (ef81539a-ac46-4e80-bc17-a0b82821b9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4c46ce-bbe5-49a8-a052-f18ed9eec494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4c46ce-bbe5-49a8-a052-f18ed9eec494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1101445604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1563f7c5-2843-474d-a30a-189da95c35e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c6ced8a9094b989b011c13487ee360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:32Z,use_quota=True,user_id='e922be3869734a028a7db9da39043412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44c3116-dc76-44c6-a5f6-3c142ffa51c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44c3116-dc76-44c6-a5f6-3c142ffa51c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add43fa7-86c1-44eb-9e06-c71373d5f6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 Jul 18 05:48:32 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add43fa7-86c1-44eb-9e06-c71373d5f6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1563f7c5-2843-474d-a30a-189da95c35e3', 'volume_name': 'volume-1563f7c5-2843-474d-a30a-189da95c35e3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3257e9da-42a2-4171-ae59-6c2cd53e9d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3257e9da-42a2-4171-ae59-6c2cd53e9d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7063a9-a7af-43ed-b2b5-831620ce26b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Volume 1563f7c5-2843-474d-a30a-189da95c35e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1563f7c5-2843-474d-a30a-189da95c35e3', 'volume_size': 1} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1101445604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1563f7c5-2843-474d-a30a-189da95c35e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c6ced8a9094b989b011c13487ee360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:32Z,use_quota=True,user_id='e922be3869734a028a7db9da39043412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Creating volume 1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:32 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:32 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 1073741824 Jul 18 05:48:32 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Flow 'volume_create_manager' (a9f1fc16-28d9-4a32-b53c-566e959dddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4393c67a-f1d2-451b-b03f-184f3e673c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4393c67a-f1d2-451b-b03f-184f3e673c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-262422325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ba2b53-da90-4797-92b7-a18ed3a657d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0962b9bc13854c5f967b667c0e6ea021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dbc77e3a-c92c-4026-b239-f52e018b50ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:32Z,use_quota=True,user_id='cbec574652fa4a5eab0569eb4bbc806e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2170e8ce-f574-4900-bd52-6cd1ca6eb4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2170e8ce-f574-4900-bd52-6cd1ca6eb4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bf9131-1b13-4e73-b12c-da582803be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bf9131-1b13-4e73-b12c-da582803be95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61ba2b53-da90-4797-92b7-a18ed3a657d6', 'volume_name': 'volume-61ba2b53-da90-4797-92b7-a18ed3a657d6', 'volume_size': 1, 'snapshot_id': 'dbc77e3a-c92c-4026-b239-f52e018b50ef'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2171e63-f219-444f-96ba-3689ac91bff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2171e63-f219-444f-96ba-3689ac91bff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97eaa013-d093-473e-a99e-5a41967cb456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Volume 61ba2b53-da90-4797-92b7-a18ed3a657d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61ba2b53-da90-4797-92b7-a18ed3a657d6', 'volume_size': 1, 'snapshot_id': 'dbc77e3a-c92c-4026-b239-f52e018b50ef'} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:32 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37" returned: 0 in 0.401s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:32 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37 Jul 18 05:48:32 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:32 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 1073741824" returned: 0 in 0.446s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:32 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 Jul 18 05:48:32 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:32 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1b931ec5-d677-4ee5-91ad-e9d022611a37" returned: 0 in 0.293s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-quobyte-1b931ec5-d677-4ee5-91ad-e9d022611a37" released by "delete_volume" :: held 0.756s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Created reservations ['e8d8765a-8992-40cb-936b-914257fb6598', 'a4501329-9df2-4212-99f8-e23579745c26', '011edd94-7793-499e-9bd6-7609f94b514a', '9bbb357a-b9d5-4eae-9ccc-78268c2c51b7'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:32 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:32 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:33 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3" returned: 0 in 0.277s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.650s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-dbc77e3a-c92c-4026-b239-f52e018b50ef-61ba2b53-da90-4797-92b7-a18ed3a657d6" by "_create_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7063a9-a7af-43ed-b2b5-831620ce26b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1563f7c5-2843-474d-a30a-189da95c35e3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df00cec5-69da-4c6c-a561-04506ca752d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-dbc77e3a-c92c-4026-b239-f52e018b50ef-61ba2b53-da90-4797-92b7-a18ed3a657d6" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Creating volume 61ba2b53-da90-4797-92b7-a18ed3a657d6 from snapshot dbc77e3a-c92c-4026-b239-f52e018b50ef {{(pid=87497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-61ba2b53-da90-4797-92b7-a18ed3a657d6" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:33 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Volume volume-1563f7c5-2843-474d-a30a-189da95c35e3 (1563f7c5-2843-474d-a30a-189da95c35e3): created successfully Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df00cec5-69da-4c6c-a561-04506ca752d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Flow 'volume_create_manager' (ef81539a-ac46-4e80-bc17-a0b82821b9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-61ba2b53-da90-4797-92b7-a18ed3a657d6" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] snapshot: dbc77e3a-c92c-4026-b239-f52e018b50ef, volume: 61ba2b53-da90-4797-92b7-a18ed3a657d6, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:48:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-38051310-998d-4a23-b4e0-2aedf23c1ef2 tempest-VolumesSnapshotListTestJSON-321230424 None] Created volume successfully. Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0625f0-f93a-4e29-a1fb-5568cedfc81e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:33 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.262s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Deleted volume successfully. Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-254d7cc9-91ae-4a95-9f6f-8e54481ead76 tempest-VolumesListAdminTestJSON-992352810 None] Lock "cinder-1b931ec5-d677-4ee5-91ad-e9d022611a37-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:33 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef Jul 18 05:48:33 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:33 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef" returned: 0 in 0.395s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f1a188-26e5-4077-9602-5358c454fbe6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:33 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 Jul 18 05:48:33 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:34 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" returned: 0 in 0.432s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:34 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:48:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:34 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 Jul 18 05:48:34 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:39 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6" returned: 0 in 4.993s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[927615d3-2112-470f-ae68-638adad74d1a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:39 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 Jul 18 05:48:39 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:39 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" returned: 0 in 0.545s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:48:39 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Converted 1024.00 MB image at 205.01 MB/s Jul 18 05:48:39 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 is being set with open permissions: ugo+rw Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:39 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 Jul 18 05:48:39 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:39 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-61ba2b53-da90-4797-92b7-a18ed3a657d6" released by "_copy_volume_from_snapshot" :: held 6.720s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-dbc77e3a-c92c-4026-b239-f52e018b50ef-61ba2b53-da90-4797-92b7-a18ed3a657d6" released by "_create_volume_from_snapshot" :: held 6.770s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.804s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.631s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Creating offline snapshot db265e57-9ddc-4a7b-a257-40819f49fea3 of volume 1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97eaa013-d093-473e-a99e-5a41967cb456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61ba2b53-da90-4797-92b7-a18ed3a657d6', 'volume_size': 1, 'snapshot_id': 'dbc77e3a-c92c-4026-b239-f52e018b50ef'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfb3d2c-fe16-4945-b8d1-3397a14ba451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[266786be-b39b-411b-ad51-1844e01826ac]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:39 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Volume volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 (61ba2b53-da90-4797-92b7-a18ed3a657d6): created successfully Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfb3d2c-fe16-4945-b8d1-3397a14ba451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Flow 'volume_create_manager' (a9f1fc16-28d9-4a32-b53c-566e959dddde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-818c28b7-69ca-439b-b5a3-5786facf4fbb tempest-VolumesDeleteCascade-1430085704 None] Created volume successfully. Jul 18 05:48:40 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 Jul 18 05:48:40 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Flow 'volume_create_manager' (9c64ef9e-11f7-44ee-912f-910c5ffc6428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3beb67-b552-4b5e-b0a3-e814e8704a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3beb67-b552-4b5e-b0a3-e814e8704a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-327937590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0df5c7d-f0cc-4763-a2be-b9478cab303b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1c4826f6a34aeabe8df60968b4dbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:40Z,use_quota=True,user_id='50e859b65b8448ce97556443e2ae972c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c80174-74c8-45d3-bce6-8042bb0b93f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c80174-74c8-45d3-bce6-8042bb0b93f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29822446-1dd4-48d5-afb3-27b087e8f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29822446-1dd4-48d5-afb3-27b087e8f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0df5c7d-f0cc-4763-a2be-b9478cab303b', 'volume_name': 'volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b', 'volume_size': 2}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f040fc-fad5-4b6f-9e7b-76840013c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f040fc-fad5-4b6f-9e7b-76840013c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9427e81d-19cb-45b9-9fcb-425b5e160a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:40 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Volume c0df5c7d-f0cc-4763-a2be-b9478cab303b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b', 'volume_size': 2} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:40 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3" returned: 0 in 0.380s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:40 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 1G Jul 18 05:48:40 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:40 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 1G" returned: 0 in 0.405s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1563f7c5-2843-474d-a30a-189da95c35e3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:40 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1563f7c5-2843-474d-a30a-189da95c35e3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 Jul 18 05:48:40 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Performing cascade delete. {{(pid=87497) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-dbc77e3a-c92c-4026-b239-f52e018b50ef-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-dbc77e3a-c92c-4026-b239-f52e018b50ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-dbc77e3a-c92c-4026-b239-f52e018b50ef" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-dbc77e3a-c92c-4026-b239-f52e018b50ef" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Deleting offline snapshot dbc77e3a-c92c-4026-b239-f52e018b50ef of volume bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] snapshot_file for this snap is: volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:48:41 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1563f7c5-2843-474d-a30a-189da95c35e3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3" returned: 0 in 0.352s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:41 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 is being set with open permissions: ugo+rw Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef765a-1909-4921-846a-b02e4baff2dc]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:41 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 Jul 18 05:48:41 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:41 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef Jul 18 05:48:41 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:41 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3" returned: 0 in 0.250s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:41 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.info Jul 18 05:48:41 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:41 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef" returned: 0 in 0.391s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a2ef55-f6a8-43ce-9a24-074599a2f288]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:41 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 Jul 18 05:48:41 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:41 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.info" returned: 0 in 0.271s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:41 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.info is being set with open permissions: ugo+rw Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:41 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.info Jul 18 05:48:41 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:41 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" returned: 0 in 0.352s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:41 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef Jul 18 05:48:41 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:41 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.info" returned: 0 in 0.256s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.698s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-327937590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0df5c7d-f0cc-4763-a2be-b9478cab303b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1c4826f6a34aeabe8df60968b4dbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:40Z,use_quota=True,user_id='50e859b65b8448ce97556443e2ae972c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Creating volume c0df5c7d-f0cc-4763-a2be-b9478cab303b {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:41 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b 2147483648 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:41 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b 2147483648 Jul 18 05:48:41 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:41 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7161ca1b-1e0a-4056-bfb0-79cdc3e36c47 tempest-VolumesSnapshotListTestJSON-321230424 None] Create snapshot completed successfully Jul 18 05:48:42 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef" returned: 0 in 0.356s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:42 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef Jul 18 05:48:42 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:42 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b 2147483648" returned: 0 in 0.505s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:42 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b Jul 18 05:48:42 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:42 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30.dbc77e3a-c92c-4026-b239-f52e018b50ef" returned: 0 in 0.280s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-dbc77e3a-c92c-4026-b239-f52e018b50ef" released by "_delete_snapshot" :: held 1.484s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" released by "delete_snapshot" :: held 1.509s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Created reservations ['bce948ed-b85e-455b-8623-43fbc1735a91', '2c7359ba-4364-4f24-805e-9e5a10f2d05a', '7a92b118-7ea9-417a-bfd6-9a56fd1f1d07', 'e0190a56-b52d-45fe-a856-50be9c2c46af'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Delete snapshot completed successfully. Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-dbc77e3a-c92c-4026-b239-f52e018b50ef-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Snapshots deleted, issuing volume delete {{(pid=87497) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:42 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[98297e40-c681-49bb-a9a7-fcc64b9c8015]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b" returned: 0 in 0.260s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9427e81d-19cb-45b9-9fcb-425b5e160a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b', 'volume_size': 2}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c392202-797a-4450-a1aa-c47764d43097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:42 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Volume volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b (c0df5c7d-f0cc-4763-a2be-b9478cab303b): created successfully Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c392202-797a-4450-a1aa-c47764d43097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Flow 'volume_create_manager' (9c64ef9e-11f7-44ee-912f-910c5ffc6428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ba670ba1-2a06-4f8f-a694-b8f1b0c83391 tempest-VolumesCloneNegativeTest-114460059 None] Created volume successfully. Jul 18 05:48:42 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 Jul 18 05:48:42 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Creating offline snapshot f863bc80-4672-4aaf-b48b-644db92681a0 of volume 1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:48:42 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc668843-2216-4c77-afb4-11d26d9913ac]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:43 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" returned: 0 in 0.381s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:43 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30 Jul 18 05:48:43 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:43 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 Jul 18 05:48:43 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:43 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" returned: 0 in 0.255s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30" released by "delete_volume" :: held 0.702s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Acquiring lock "cinder-c0df5c7d-f0cc-4763-a2be-b9478cab303b-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Created reservations ['58c6efd9-8927-4b72-9fbd-c9d217bf411b', 'dd57b9aa-e5c1-478c-afb4-b2941179c305', '8ba2dbc7-7010-48f8-bc0e-422a22b1a690', '4bd4f631-d557-4339-95a4-6a3d98c74255'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:43 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3" returned: 0 in 0.415s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1563f7c5-2843-474d-a30a-189da95c35e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Lock "cinder-c0df5c7d-f0cc-4763-a2be-b9478cab303b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:43 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 1G Jul 18 05:48:43 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Acquiring lock "cinder-quobyte-c0df5c7d-f0cc-4763-a2be-b9478cab303b" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Lock "cinder-quobyte-c0df5c7d-f0cc-4763-a2be-b9478cab303b" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a7a377-168d-4cdc-b99b-6353564a5605]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:43 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:43 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:43 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b Jul 18 05:48:43 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:43 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.277s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Deleted volume successfully. Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a2af0181-2013-4f13-9018-848b4c81661a tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-bcc8825c-368a-4b64-ae3a-6f9a96bc8f30-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:43 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 1G" returned: 0 in 0.470s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:43 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 Jul 18 05:48:43 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:43 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b" returned: 0 in 0.396s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:43 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b Jul 18 05:48:43 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:44 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:44 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0" returned: 0 in 0.349s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:44 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 is being set with open permissions: ugo+rw Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0df5c7d-f0cc-4763-a2be-b9478cab303b" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:44 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 Jul 18 05:48:44 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Lock "cinder-quobyte-c0df5c7d-f0cc-4763-a2be-b9478cab303b" released by "delete_volume" :: held 0.761s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Created reservations ['9069d781-4d3e-4031-8fe2-123693e7d8b1', '02cb8aad-6fb6-4312-a323-64fa9e618ae1', '2d5b2fdd-ba61-42f1-bac3-db0926f2d7ae', 'b7a59788-a870-4eeb-8b78-ef789a028198'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-61ba2b53-da90-4797-92b7-a18ed3a657d6-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-61ba2b53-da90-4797-92b7-a18ed3a657d6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:44 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:44 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "cinder-quobyte-61ba2b53-da90-4797-92b7-a18ed3a657d6" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-61ba2b53-da90-4797-92b7-a18ed3a657d6" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed09ef2-1896-487e-90f8-57df98e58363]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:44 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0" returned: 0 in 0.317s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.667s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:44 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e9802491-b1e9-4fce-9df9-06c00b7d3749 tempest-VolumesSnapshotListTestJSON-321230424 None] Create snapshot completed successfully Jul 18 05:48:44 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 Jul 18 05:48:44 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:44 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.280s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:44 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Deleted volume successfully. Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-17c7b4b3-359e-4739-b4de-7e2c33d31ab5 tempest-VolumesCloneNegativeTest-114460059 None] Lock "cinder-c0df5c7d-f0cc-4763-a2be-b9478cab303b-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:44 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6" returned: 0 in 0.449s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:44 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6 Jul 18 05:48:45 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:45 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-61ba2b53-da90-4797-92b7-a18ed3a657d6" returned: 0 in 0.317s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Creating offline snapshot b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d of volume 1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-quobyte-61ba2b53-da90-4797-92b7-a18ed3a657d6" released by "delete_volume" :: held 0.863s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a12119-a7de-4fee-847d-c1095e0dc230]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Created reservations ['e1e40604-ee41-403d-b969-02491031d06a', '7f88889a-cb52-4408-a80a-885ab4a00fb5', '3de365f7-a647-4d81-8a7e-0dccf6a85de8', '54977365-9f2e-4700-87cd-683f4ca9925e'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:45 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 Jul 18 05:48:45 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:45 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:45 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:45 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0" returned: 0 in 0.492s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1563f7c5-2843-474d-a30a-189da95c35e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:45 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.341s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:45 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Deleted volume successfully. Jul 18 05:48:45 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d 1G Jul 18 05:48:45 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-85f6141a-bd15-4019-808a-b5662311f9a4 tempest-VolumesDeleteCascade-1430085704 None] Lock "cinder-61ba2b53-da90-4797-92b7-a18ed3a657d6-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:46 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d 1G" returned: 0 in 0.615s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:46 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d Jul 18 05:48:46 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:46 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:46 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d is being set with open permissions: ugo+rw Jul 18 05:48:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:46 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d Jul 18 05:48:46 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:47 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d" returned: 0 in 0.275s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b48a342b-1131-4265-b462-cf803174ebe2 tempest-VolumesSnapshotListTestJSON-321230424 None] Create snapshot completed successfully Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (5aa1224f-6d5d-4b26-b255-66fe0fabd948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ccab2a-a7a2-4c86-ad3f-db79b75fc922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ccab2a-a7a2-4c86-ad3f-db79b75fc922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-383627961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e808df-665b-4dc5-8b34-4e66aed58664,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:48Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de61821-60d5-4d46-ac95-4d66876b4157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de61821-60d5-4d46-ac95-4d66876b4157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eecf03-206f-49f0-8b4e-767572805f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eecf03-206f-49f0-8b4e-767572805f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e808df-665b-4dc5-8b34-4e66aed58664', 'volume_name': 'volume-84e808df-665b-4dc5-8b34-4e66aed58664', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0410ddd0-662f-42ef-9085-817776478e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0410ddd0-662f-42ef-9085-817776478e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1367d6f-e6c9-4afe-a438-bdf94a23b871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:48 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Volume 84e808df-665b-4dc5-8b34-4e66aed58664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e808df-665b-4dc5-8b34-4e66aed58664', 'volume_size': 1} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-383627961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e808df-665b-4dc5-8b34-4e66aed58664,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:48Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Creating volume 84e808df-665b-4dc5-8b34-4e66aed58664 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:48 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" acquired by "delete_snapshot" :: waited 0.087s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-quobyte-b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:48 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664 1073741824 Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:48 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Deleting offline snapshot b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d of volume 1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] snapshot_file for this snap is: volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7954339-1420-4004-855e-5e3830a3c98e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:48 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d Jul 18 05:48:48 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:48 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:48 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d" returned: 0 in 0.477s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1563f7c5-2843-474d-a30a-189da95c35e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664 1073741824" returned: 0 in 0.591s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9dfb9b-99ff-4eac-a69e-88449d315728]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:48 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664 Jul 18 05:48:48 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:49 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 Jul 18 05:48:49 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:49 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664" returned: 0 in 0.281s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1367d6f-e6c9-4afe-a438-bdf94a23b871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e808df-665b-4dc5-8b34-4e66aed58664', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31030a4b-1381-4662-8203-e7a83182ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:49 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Volume volume-84e808df-665b-4dc5-8b34-4e66aed58664 (84e808df-665b-4dc5-8b34-4e66aed58664): created successfully Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31030a4b-1381-4662-8203-e7a83182ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (5aa1224f-6d5d-4b26-b255-66fe0fabd948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:49 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-af9b5ede-8551-46f7-80bf-6855033a8718 tempest-VolumesGetTest-993584081 None] Created volume successfully. Jul 18 05:48:49 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0" returned: 0 in 0.429s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1563f7c5-2843-474d-a30a-189da95c35e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:49 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d Jul 18 05:48:49 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:49 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d" returned: 0 in 0.450s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:49 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d Jul 18 05:48:49 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:50 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d" returned: 0 in 0.263s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d" released by "_delete_snapshot" :: held 1.738s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" released by "delete_snapshot" :: held 1.771s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Created reservations ['6e16088d-9e67-421c-a3cb-c439550da203', 'c1bf5586-f828-49bd-9293-223819778069', 'e7477635-6758-4fad-a1c1-1622e505e63c', '12312883-3257-4782-90d8-47e82b8730cc'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:50 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Delete snapshot completed successfully. Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1a63b9a4-5329-43c7-b455-cdbeedbd2d90 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-b2cb5703-3b17-4bd3-bbee-f3ca8cb51d6d-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-f863bc80-4672-4aaf-b48b-644db92681a0-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-f863bc80-4672-4aaf-b48b-644db92681a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-quobyte-f863bc80-4672-4aaf-b48b-644db92681a0" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-f863bc80-4672-4aaf-b48b-644db92681a0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Deleting offline snapshot f863bc80-4672-4aaf-b48b-644db92681a0 of volume 1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] snapshot_file for this snap is: volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d88bd6-7cfe-4cb5-a76b-f6ba916e7d51]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:50 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 Jul 18 05:48:50 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:50 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0" returned: 0 in 0.462s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1563f7c5-2843-474d-a30a-189da95c35e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[118e4eb2-b8e3-4042-a182-919cb6f25a07]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:51 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 Jul 18 05:48:51 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=234,cinder:SELECT=170,cinder:DELETE=24,cinder:INSERT=51 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (a9b43ffe-7659-4e22-88d0-e54f185837e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d9be7b-be61-4e51-b3b2-f3fb3a6e6377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d9be7b-be61-4e51-b3b2-f3fb3a6e6377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-602704398',display_name='tempest-VolumesGetTest-Volume-2110674129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a8f031-8238-41ac-a204-8de6d7e94470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:51Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dd8b34-eb45-4aa3-aa9b-931f658a30c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dd8b34-eb45-4aa3-aa9b-931f658a30c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bca1d64-7a08-47a1-b376-5799466ad06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bca1d64-7a08-47a1-b376-5799466ad06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a8f031-8238-41ac-a204-8de6d7e94470', 'volume_name': 'volume-47a8f031-8238-41ac-a204-8de6d7e94470', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9262e3-556d-4b61-8cca-726c9298d150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9262e3-556d-4b61-8cca-726c9298d150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aa63be-8464-4557-9009-0480946a5695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:51 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Volume 47a8f031-8238-41ac-a204-8de6d7e94470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a8f031-8238-41ac-a204-8de6d7e94470', 'volume_size': 1} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-602704398',display_name='tempest-VolumesGetTest-Volume-2110674129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a8f031-8238-41ac-a204-8de6d7e94470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:51Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Creating volume 47a8f031-8238-41ac-a204-8de6d7e94470 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:51 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:51 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470 1073741824 Jul 18 05:48:51 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:51 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3" returned: 0 in 0.405s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1563f7c5-2843-474d-a30a-189da95c35e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:51 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 Jul 18 05:48:51 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:51 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470 1073741824" returned: 0 in 0.504s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:51 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470 Jul 18 05:48:51 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:51 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0" returned: 0 in 0.463s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:51 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0 Jul 18 05:48:51 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:52 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470" returned: 0 in 0.268s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aa63be-8464-4557-9009-0480946a5695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a8f031-8238-41ac-a204-8de6d7e94470', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67db8877-71ab-4b54-87c9-e89b3fdae370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:52 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.f863bc80-4672-4aaf-b48b-644db92681a0" returned: 0 in 0.262s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:52 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Volume volume-47a8f031-8238-41ac-a204-8de6d7e94470 (47a8f031-8238-41ac-a204-8de6d7e94470): created successfully Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67db8877-71ab-4b54-87c9-e89b3fdae370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (a9b43ffe-7659-4e22-88d0-e54f185837e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-f863bc80-4672-4aaf-b48b-644db92681a0" released by "_delete_snapshot" :: held 1.745s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" released by "delete_snapshot" :: held 1.770s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-fe24eacf-ae4b-43a5-a796-9ea844865dfe tempest-VolumesGetTest-993584081 None] Created volume successfully. Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Created reservations ['cfeb3b3c-f124-49de-a464-47bc176b90d0', '9d79d79c-47f8-4bff-92c6-e1485bc7fb5d', 'fe544762-b6ee-4227-aa64-ff8019616a36', 'd6148c9a-b65e-487a-aa53-87a62d13e23b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Delete snapshot completed successfully. Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a4c6b32a-2a82-42af-8fce-7b4eaf058dd5 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-f863bc80-4672-4aaf-b48b-644db92681a0-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-db265e57-9ddc-4a7b-a257-40819f49fea3-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-db265e57-9ddc-4a7b-a257-40819f49fea3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-quobyte-db265e57-9ddc-4a7b-a257-40819f49fea3" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-db265e57-9ddc-4a7b-a257-40819f49fea3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Deleting offline snapshot db265e57-9ddc-4a7b-a257-40819f49fea3 of volume 1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] snapshot_file for this snap is: volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff50f17-ee7a-4515-9ddf-54c216b61bb7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:52 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 Jul 18 05:48:52 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:53 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3" returned: 0 in 0.443s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1563f7c5-2843-474d-a30a-189da95c35e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0919dbf-998c-45d4-8ed5-c966b6942cf1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:53 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 Jul 18 05:48:53 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-47a8f031-8238-41ac-a204-8de6d7e94470-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Lock "cinder-47a8f031-8238-41ac-a204-8de6d7e94470-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=184,cinder:INSERT=68,cinder:UPDATE=214,cinder:DELETE=16 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-quobyte-47a8f031-8238-41ac-a204-8de6d7e94470" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-47a8f031-8238-41ac-a204-8de6d7e94470" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:53 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3" returned: 0 in 0.492s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[366fbbb9-b598-49de-94a4-5c2c344e0c9e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:53 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 Jul 18 05:48:53 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:53 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470 Jul 18 05:48:53 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:54 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3" returned: 0 in 0.441s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:54 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3 Jul 18 05:48:54 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:54 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470" returned: 0 in 0.461s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:54 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470 Jul 18 05:48:54 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:54 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3.db265e57-9ddc-4a7b-a257-40819f49fea3" returned: 0 in 0.282s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-db265e57-9ddc-4a7b-a257-40819f49fea3" released by "_delete_snapshot" :: held 1.793s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" released by "delete_snapshot" :: held 1.820s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:54 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47a8f031-8238-41ac-a204-8de6d7e94470" returned: 0 in 0.329s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-47a8f031-8238-41ac-a204-8de6d7e94470" released by "delete_volume" :: held 0.856s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Created reservations ['3b752554-0884-4ac5-b7d5-09210a36c879', '0e1e2b8d-00d0-4b8c-9875-41a0ec299374', '85e1d701-be8e-4d0e-9872-c04f1a694c4d', 'f36f5b0d-d3c5-4c6d-a8a1-ca58b7ca4bc5'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Created reservations ['af7d4bb3-75c9-4a98-8c45-1dcd2f6249bb', '9cd8eb0f-97a4-4617-aca7-6d55f075c7a1', 'df5922ad-1e0a-404e-b647-db096db3b482', '3ecc7952-a28c-449f-af4d-2df4aefe5bb7'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:54 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Delete snapshot completed successfully. Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a21a2c5c-efcc-4feb-900d-3609a24cd2f1 tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-db265e57-9ddc-4a7b-a257-40819f49fea3-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:54 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:54 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-1563f7c5-2843-474d-a30a-189da95c35e3-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-84e808df-665b-4dc5-8b34-4e66aed58664-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-1563f7c5-2843-474d-a30a-189da95c35e3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Lock "cinder-84e808df-665b-4dc5-8b34-4e66aed58664-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-quobyte-84e808df-665b-4dc5-8b34-4e66aed58664" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" acquired by "delete_volume" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:55 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.384s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-84e808df-665b-4dc5-8b34-4e66aed58664" acquired by "delete_volume" :: waited 0.065s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0028d98-b894-4eb4-a583-ae079979b9a3]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c01efa5-5fc4-45c1-aa59-84fa5d666136]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:48:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Deleted volume successfully. Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2d0b64fc-a63a-4e1a-8b90-9a4fd9cecc57 tempest-VolumesGetTest-993584081 None] Lock "cinder-47a8f031-8238-41ac-a204-8de6d7e94470-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:55 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 Jul 18 05:48:55 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:55 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664 Jul 18 05:48:55 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:55 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3" returned: 0 in 0.434s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:55 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664" returned: 0 in 0.443s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:55 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3 Jul 18 05:48:55 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:55 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664 Jul 18 05:48:55 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:55 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1563f7c5-2843-474d-a30a-189da95c35e3" returned: 0 in 0.285s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:55 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-84e808df-665b-4dc5-8b34-4e66aed58664" returned: 0 in 0.271s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-quobyte-1563f7c5-2843-474d-a30a-189da95c35e3" released by "delete_volume" :: held 0.827s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-84e808df-665b-4dc5-8b34-4e66aed58664" released by "delete_volume" :: held 0.780s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Created reservations ['87f0ac10-4a9c-46a5-91f1-bdcdd7c82568', '6481292b-e67b-4702-af6f-b551f91ef016', 'b6cb846e-540a-47a1-8a43-3bc73c19e62a', '19b10d84-08d9-4fa7-8a05-dc87eafa0e46'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:55 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Created reservations ['e4ff5929-3a6f-4bbe-9461-ce28f6c4d6ae', 'b783cbb1-490a-4a70-9afa-ac5d2510e9a6', '9b89899a-a38f-409f-8ea4-8242b8925628', 'f04cc1f4-9af4-4e5c-9233-bc379bddb404'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:56 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:56 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:56 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:48:56 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:56 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.325s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Deleted volume successfully. Jul 18 05:48:56 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.272s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:48:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Deleted volume successfully. Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22de45d1-da38-491a-b1da-bc99d32d8f1e tempest-VolumesSnapshotListTestJSON-321230424 None] Lock "cinder-1563f7c5-2843-474d-a30a-189da95c35e3-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f8931dfd-cc8d-455d-8de9-0f995f82112d tempest-VolumesGetTest-993584081 None] Lock "cinder-84e808df-665b-4dc5-8b34-4e66aed58664-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (e183059f-a2b8-4593-a8cf-d985a338a6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b24ea4-7f80-4f6f-865b-3b1925ac5c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b24ea4-7f80-4f6f-865b-3b1925ac5c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-162296199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b684427-a139-487f-bd54-c785b5a707b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:58Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170ef4db-7c9e-4f69-958b-61ed2fc11666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170ef4db-7c9e-4f69-958b-61ed2fc11666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3174970-2f86-435e-811a-7dd1d5e5b761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3174970-2f86-435e-811a-7dd1d5e5b761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b684427-a139-487f-bd54-c785b5a707b5', 'volume_name': 'volume-4b684427-a139-487f-bd54-c785b5a707b5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9970890-ad60-4765-b97e-cd63acb30e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9970890-ad60-4765-b97e-cd63acb30e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9914bdcb-09f7-4d1f-a93d-087177b02ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:57 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Volume 4b684427-a139-487f-bd54-c785b5a707b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b684427-a139-487f-bd54-c785b5a707b5', 'volume_size': 1} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-162296199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b684427-a139-487f-bd54-c785b5a707b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:58Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Creating volume 4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:57 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:57 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 1073741824 Jul 18 05:48:57 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:58 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 1073741824" returned: 0 in 0.538s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:58 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 Jul 18 05:48:58 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:58 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5" returned: 0 in 0.323s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9914bdcb-09f7-4d1f-a93d-087177b02ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b684427-a139-487f-bd54-c785b5a707b5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98dc9ef-9223-4d4d-86ba-135d24ee6f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Flow 'volume_create_manager' (6fa94475-1e74-46bd-81bc-7aeaf24fbb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7288b9d7-3fc1-4fba-b1c1-bfadeeca6d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:58 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Volume volume-4b684427-a139-487f-bd54-c785b5a707b5 (4b684427-a139-487f-bd54-c785b5a707b5): created successfully Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98dc9ef-9223-4d4d-86ba-135d24ee6f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (e183059f-a2b8-4593-a8cf-d985a338a6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7288b9d7-3fc1-4fba-b1c1-bfadeeca6d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1532566066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc6992f-1923-4075-8fcc-45f8cd1cf28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f6a6cecddf487d8474bb0dd0538bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:59Z,use_quota=True,user_id='6f12baf1ef0947ce930b411cf4de3048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526077f9-2812-41da-b5f9-041e3996b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526077f9-2812-41da-b5f9-041e3996b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b07ca2-ac45-4d0d-abba-e85b38425cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b07ca2-ac45-4d0d-abba-e85b38425cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc6992f-1923-4075-8fcc-45f8cd1cf28b', 'volume_name': 'volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f1944f-31ad-4f6f-bc2e-8a273c118293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f1944f-31ad-4f6f-bc2e-8a273c118293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a1dcb6-769e-46b7-9b7f-f086dc4ab5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:58 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Volume 4bc6992f-1923-4075-8fcc-45f8cd1cf28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b', 'volume_size': 1} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1532566066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc6992f-1923-4075-8fcc-45f8cd1cf28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f6a6cecddf487d8474bb0dd0538bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:48:59Z,use_quota=True,user_id='6f12baf1ef0947ce930b411cf4de3048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Creating volume 4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:48:58 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:48:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:58 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-bc0fca95-e0d4-4291-850e-86ea42cbdd96 tempest-VolumesGetTest-993584081 None] Created volume successfully. Jul 18 05:48:58 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b 1073741824 Jul 18 05:48:58 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:59 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b 1073741824" returned: 0 in 0.480s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:48:59 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b Jul 18 05:48:59 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:48:59 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 18 05:48:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" returned: 0 in 0.290s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:48:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:48:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:48:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a1dcb6-769e-46b7-9b7f-f086dc4ab5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d441b265-e8c0-4bf9-897c-1573c03dbebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:48:59 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Volume volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b (4bc6992f-1923-4075-8fcc-45f8cd1cf28b): created successfully Jul 18 05:48:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d441b265-e8c0-4bf9-897c-1573c03dbebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:48:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Flow 'volume_create_manager' (6fa94475-1e74-46bd-81bc-7aeaf24fbb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:48:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8ca466c0-3f39-4104-85a1-d195b1d44860 tempest-VolumesActionsTest-785566700 None] Created volume successfully. Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (7723bcad-8c2d-402a-8bc0-7a2df9bcdc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e4faf3-7359-447f-be3c-82e9551371c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e4faf3-7359-447f-be3c-82e9551371c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1562257721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a1fed4-f4e0-4571-a315-010be85b1c48,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4b684427-a139-487f-bd54-c785b5a707b5,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:00Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50855ad7-25f8-4798-bbd6-841eae4e81c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50855ad7-25f8-4798-bbd6-841eae4e81c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581098b1-9268-47b7-9a78-3b88e54c254f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581098b1-9268-47b7-9a78-3b88e54c254f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a3a1fed4-f4e0-4571-a315-010be85b1c48', 'volume_name': 'volume-a3a1fed4-f4e0-4571-a315-010be85b1c48', 'volume_size': 1, 'source_volid': '4b684427-a139-487f-bd54-c785b5a707b5', 'source_volstatus': 'available'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216a0fc8-1c27-4c6c-bade-06ff8a755d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216a0fc8-1c27-4c6c-bade-06ff8a755d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74d601b-23ce-4c6e-a73d-f4ee901c954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:00 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Volume a3a1fed4-f4e0-4571-a315-010be85b1c48: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a3a1fed4-f4e0-4571-a315-010be85b1c48', 'volume_size': 1, 'source_volid': '4b684427-a139-487f-bd54-c785b5a707b5', 'source_volstatus': 'available'} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:00 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Cloning volume 4b684427-a139-487f-bd54-c785b5a707b5 to volume a3a1fed4-f4e0-4571-a315-010be85b1c48 Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Creating offline snapshot b214585c-5e83-4895-9bd6-c4fbe74eabd8 of volume 4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4b8f74-059f-4152-8b31-3919a4d4fd45]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:00 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 Jul 18 05:49:00 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:01 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5" returned: 0 in 0.404s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:01 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 1G Jul 18 05:49:01 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:01 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 1G" returned: 0 in 0.481s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b684427-a139-487f-bd54-c785b5a707b5 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:01 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b684427-a139-487f-bd54-c785b5a707b5 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 Jul 18 05:49:01 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:01 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b684427-a139-487f-bd54-c785b5a707b5 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8" returned: 0 in 0.288s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:01 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 is being set with open permissions: ugo+rw Jul 18 05:49:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:01 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 Jul 18 05:49:01 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:02 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8" returned: 0 in 0.276s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:02 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.info Jul 18 05:49:02 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:02 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.info" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:02 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.info is being set with open permissions: ugo+rw Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:02 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.info Jul 18 05:49:02 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:02 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.info" returned: 0 in 0.293s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-quobyte-a3a1fed4-f4e0-4571-a315-010be85b1c48" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-a3a1fed4-f4e0-4571-a315-010be85b1c48" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] snapshot: b214585c-5e83-4895-9bd6-c4fbe74eabd8, volume: a3a1fed4-f4e0-4571-a315-010be85b1c48, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66e4c2a-a93c-4ff0-aad0-c1d736d7beec]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:02 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 Jul 18 05:49:02 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:03 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8" returned: 0 in 0.507s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b684427-a139-487f-bd54-c785b5a707b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:49:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:49:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:49:03 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71ed890-7b80-4a03-8df4-ef3b0ca788ec]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:03 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 Jul 18 05:49:03 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:03 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5" returned: 0 in 0.477s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:03 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:49:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:03 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 Jul 18 05:49:03 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:06 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:49:06 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:06 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.484s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:49:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:49:09 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48" returned: 0 in 6.055s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:09 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6f9234-631e-436a-9bea-4a42dd1323a0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:10 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 Jul 18 05:49:10 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:10 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5" returned: 0 in 0.774s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:10 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:49:10 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Converted 1024.00 MB image at 169.09 MB/s Jul 18 05:49:10 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 is being set with open permissions: ugo+rw Jul 18 05:49:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:10 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 Jul 18 05:49:10 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:11 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48" returned: 0 in 0.538s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-a3a1fed4-f4e0-4571-a315-010be85b1c48" released by "_copy_volume_from_snapshot" :: held 8.475s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-quobyte-b214585c-5e83-4895-9bd6-c4fbe74eabd8" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-b214585c-5e83-4895-9bd6-c4fbe74eabd8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Deleting offline snapshot b214585c-5e83-4895-9bd6-c4fbe74eabd8 of volume 4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:49:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] snapshot_file for this snap is: volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:49:11 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[057afd19-8ec0-444d-9bb9-a1992d7ae9eb]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:11 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 Jul 18 05:49:11 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:12 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=43,cinder:SELECT=35,cinder:INSERT=20,cinder:DELETE=1 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:49:12 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8" returned: 0 in 0.740s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:12 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b684427-a139-487f-bd54-c785b5a707b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:49:12 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54b90df-dda6-415b-9545-33cf483262e6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:12 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 Jul 18 05:49:12 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:12 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5" returned: 0 in 0.458s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:12 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 Jul 18 05:49:12 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:13 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8" returned: 0 in 0.442s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:13 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8 Jul 18 05:49:13 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:13 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5.b214585c-5e83-4895-9bd6-c4fbe74eabd8" returned: 0 in 0.290s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-b214585c-5e83-4895-9bd6-c4fbe74eabd8" released by "_delete_snapshot" :: held 2.202s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.973s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74d601b-23ce-4c6e-a73d-f4ee901c954d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a1fed4-f4e0-4571-a315-010be85b1c48', 'volume_size': 1, 'source_volid': '4b684427-a139-487f-bd54-c785b5a707b5', 'source_volstatus': 'available'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9654de16-04c1-48c5-80f4-f8d8eb888952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:13 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Volume volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 (a3a1fed4-f4e0-4571-a315-010be85b1c48): created successfully Jul 18 05:49:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9654de16-04c1-48c5-80f4-f8d8eb888952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (7723bcad-8c2d-402a-8bc0-7a2df9bcdc4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:13 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-3477c3a7-5b6b-4f97-899b-46f3cd9f5104 tempest-VolumesGetTest-993584081 None] Created volume successfully. Jul 18 05:49:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b0cb632b-bc27-4f70-9cc2-16bf6c7e4fc0 tempest-VolumesActionsTest-785566700 None] Acquiring lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" by "attach_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b0cb632b-bc27-4f70-9cc2-16bf6c7e4fc0 tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" acquired by "attach_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b0cb632b-bc27-4f70-9cc2-16bf6c7e4fc0 tempest-VolumesActionsTest-785566700 None] Attaching volume 4bc6992f-1923-4075-8fcc-45f8cd1cf28b to instance fff57bfc-3994-4bd9-872d-2e76ac285c28 at mountpoint /dev/vdb on host None. Jul 18 05:49:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b0cb632b-bc27-4f70-9cc2-16bf6c7e4fc0 tempest-VolumesActionsTest-785566700 None] Attach volume completed successfully. Jul 18 05:49:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b0cb632b-bc27-4f70-9cc2-16bf6c7e4fc0 tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" released by "attach_volume" :: held 0.139s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9589281c-e45d-4924-8123-03d23c95a210 tempest-VolumesActionsTest-785566700 None] Acquiring lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b-detach_volume" by "detach_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9589281c-e45d-4924-8123-03d23c95a210 tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:15 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9589281c-e45d-4924-8123-03d23c95a210 tempest-VolumesActionsTest-785566700 None] Detaching volume 4bc6992f-1923-4075-8fcc-45f8cd1cf28b from instance fff57bfc-3994-4bd9-872d-2e76ac285c28. Jul 18 05:49:15 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9589281c-e45d-4924-8123-03d23c95a210 tempest-VolumesActionsTest-785566700 None] Detach volume completed successfully. Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-9589281c-e45d-4924-8123-03d23c95a210 tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (1846baab-f980-45d5-9863-6364269f1932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374e8fa8-414e-40e3-a759-734574b2d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374e8fa8-414e-40e3-a759-734574b2d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-445487139',display_name='tempest-VolumesGetTest-Volume-930271560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74352f6d-cc77-4c57-884f-d31047cf6409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:16Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ad5510-dc44-4968-9467-2f82c6b51088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ad5510-dc44-4968-9467-2f82c6b51088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50af416c-6933-4b77-88a7-d01f3e5863eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50af416c-6933-4b77-88a7-d01f3e5863eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74352f6d-cc77-4c57-884f-d31047cf6409', 'volume_name': 'volume-74352f6d-cc77-4c57-884f-d31047cf6409', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe118967-1da3-4fea-8ba6-4716428af798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe118967-1da3-4fea-8ba6-4716428af798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1e7d76-a46f-4e8c-9054-9a64b15f0ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Volume 74352f6d-cc77-4c57-884f-d31047cf6409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74352f6d-cc77-4c57-884f-d31047cf6409', 'volume_size': 1} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-445487139',display_name='tempest-VolumesGetTest-Volume-930271560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74352f6d-cc77-4c57-884f-d31047cf6409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:16Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Creating volume 74352f6d-cc77-4c57-884f-d31047cf6409 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:49:15 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:49:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:15 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409 1073741824 Jul 18 05:49:15 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:16 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409 1073741824" returned: 0 in 0.739s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:16 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409 Jul 18 05:49:16 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:16 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409" returned: 0 in 0.271s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:49:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1e7d76-a46f-4e8c-9054-9a64b15f0ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74352f6d-cc77-4c57-884f-d31047cf6409', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6373b93-0849-4389-a79a-56abd0017c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Volume volume-74352f6d-cc77-4c57-884f-d31047cf6409 (74352f6d-cc77-4c57-884f-d31047cf6409): created successfully Jul 18 05:49:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6373b93-0849-4389-a79a-56abd0017c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (1846baab-f980-45d5-9863-6364269f1932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:17 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c812dca5-8c7b-4ded-b639-d2797d9100b3 tempest-VolumesGetTest-993584081 None] Created volume successfully. Jul 18 05:49:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-74352f6d-cc77-4c57-884f-d31047cf6409-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Lock "cinder-74352f6d-cc77-4c57-884f-d31047cf6409-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-quobyte-74352f6d-cc77-4c57-884f-d31047cf6409" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-74352f6d-cc77-4c57-884f-d31047cf6409" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:18 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc92f0a-35d2-4f4f-918c-a59c7bb96f3d]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:18 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409 Jul 18 05:49:18 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:18 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409" returned: 0 in 0.492s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:18 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409 Jul 18 05:49:18 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:18 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-74352f6d-cc77-4c57-884f-d31047cf6409" returned: 0 in 0.262s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-74352f6d-cc77-4c57-884f-d31047cf6409" released by "delete_volume" :: held 0.805s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:18 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Created reservations ['151e380e-92c9-4360-bc3d-d15b4f017b9a', '8f2add6c-60b4-42ac-a996-ac41905f153b', '338d2fa8-ad0d-4569-a7dc-5c4d9ff4c26c', '9b823d31-f760-478c-a6da-64bacf40c3d7'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:19 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:49:19 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-a3a1fed4-f4e0-4571-a315-010be85b1c48-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Lock "cinder-a3a1fed4-f4e0-4571-a315-010be85b1c48-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-quobyte-a3a1fed4-f4e0-4571-a315-010be85b1c48" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-a3a1fed4-f4e0-4571-a315-010be85b1c48" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d97150a-74cd-433f-a8b0-8f009fe1c017]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:19 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.350s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:49:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Deleted volume successfully. Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d57808f3-50e4-4f38-9302-9dadb3ecb305 tempest-VolumesGetTest-993584081 None] Lock "cinder-74352f6d-cc77-4c57-884f-d31047cf6409-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:19 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 Jul 18 05:49:19 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:19 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48" returned: 0 in 0.437s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:19 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48 Jul 18 05:49:19 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:20 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a3a1fed4-f4e0-4571-a315-010be85b1c48" returned: 0 in 0.296s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-a3a1fed4-f4e0-4571-a315-010be85b1c48" released by "delete_volume" :: held 0.787s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Created reservations ['d9d8c1fa-8ebd-4526-b337-09ce5aa14009', '9df80325-b199-4d58-9500-7ac91506ff18', '0963a09e-af43-45e4-8ada-8c2092e97494', 'f3b44915-e591-4ae4-b520-c316e121f994'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:20 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:49:20 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-4b684427-a139-487f-bd54-c785b5a707b5-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Lock "cinder-4b684427-a139-487f-bd54-c785b5a707b5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:20 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.344s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-quobyte-4b684427-a139-487f-bd54-c785b5a707b5" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Deleted volume successfully. Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-4b684427-a139-487f-bd54-c785b5a707b5" acquired by "delete_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-436bdd67-5386-470d-beb5-33aed1cc4b26 tempest-VolumesGetTest-993584081 None] Lock "cinder-a3a1fed4-f4e0-4571-a315-010be85b1c48-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb5db82-54e4-465c-888b-991ff42f1d9a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:20 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 Jul 18 05:49:20 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:21 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5" returned: 0 in 0.417s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:21 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5 Jul 18 05:49:21 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:21 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4b684427-a139-487f-bd54-c785b5a707b5" returned: 0 in 0.252s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-4b684427-a139-487f-bd54-c785b5a707b5" released by "delete_volume" :: held 0.763s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Created reservations ['8acd9816-1885-446d-a6c1-2d1c8e8a5b96', '741ba2ef-a688-4665-abb3-182289b116c2', '58eea301-63b4-4819-b188-1a92e539cefa', 'b8112f2b-09c4-427f-bd58-72b0c4adde37'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:21 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:49:21 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:22 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.524s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:22 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:49:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Deleted volume successfully. Jul 18 05:49:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0018a27c-7e95-4870-97f0-b78bc0f6f278 tempest-VolumesGetTest-993584081 None] Lock "cinder-4b684427-a139-487f-bd54-c785b5a707b5-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (0d0c542d-7963-41d5-9d6d-48c61112a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9050d42b-151d-457b-91fa-0e633ae5c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9050d42b-151d-457b-91fa-0e633ae5c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1764653736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99af4714-d141-47af-9902-a448c8675095,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:23Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6056972f-8cad-4d2e-8eed-9c5c1dd40f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6056972f-8cad-4d2e-8eed-9c5c1dd40f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372035b2-1c1d-4077-92d7-1a8d23bd1745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.image.glance [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Creating Keystone auth plugin from conf {{(pid=87497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372035b2-1c1d-4077-92d7-1a8d23bd1745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99af4714-d141-47af-9902-a448c8675095', 'volume_name': 'volume-99af4714-d141-47af-9902-a448c8675095', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04aa071f-da95-430f-b64f-c5d33b023140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04aa071f-da95-430f-b64f-c5d33b023140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b2f23e-359a-4c55-9626-9a198941050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:23 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Volume 99af4714-d141-47af-9902-a448c8675095: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99af4714-d141-47af-9902-a448c8675095', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 18 05:49:23 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Trying to clone 99af4714-d141-47af-9902-a448c8675095 from image 0d6393c9-e8a0-4628-b021-8c9aa5777656 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]). {{(pid=87497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 05:49:24 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 05:49:24 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Image download 20.69 MB at 20.69 MB/s Jul 18 05:49:24 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2be7d89-3da5-42b2-bc96-212ab41b32eb]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:24 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD Jul 18 05:49:24 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:24 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:24 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Temporary image 0d6393c9-e8a0-4628-b021-8c9aa5777656 is fetched for user 9c6caf6c03ca4be192b2983062a21683. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 05:49:24 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[62126f89-53f4-4551-a0d9-2f45b67f1efe]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:24 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD Jul 18 05:49:24 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:25 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1764653736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99af4714-d141-47af-9902-a448c8675095,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:23Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Creating volume 99af4714-d141-47af-9902-a448c8675095 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:49:25 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:49:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:25 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 1073741824 Jul 18 05:49:25 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:25 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 1073741824" returned: 0 in 0.976s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:26 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 Jul 18 05:49:26 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:26 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095" returned: 0 in 0.467s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:49:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:26 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Attempting download of 0d6393c9-e8a0-4628-b021-8c9aa5777656 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}])) to volume 99af4714-d141-47af-9902-a448c8675095. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 05:49:26 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa0f923-18a1-4c4f-a7f1-719acd32401a]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_lz6z5vn1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:26 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_lz6z5vn1 Jul 18 05:49:26 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:27 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_lz6z5vn1" returned: 0 in 0.433s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_lz6z5vn1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:27 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_lz6z5vn1 Jul 18 05:49:27 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:27 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_lz6z5vn1" returned: 1 in 0.573s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_lz6z5vn1' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:49:27 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5448a7-ace6-42b2-9264-81ee01af5a0e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:27 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD Jul 18 05:49:27 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:28 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:28 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] 0d6393c9-e8a0-4628-b021-8c9aa5777656 was qcow2, converting to qcow2 {{(pid=87497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 05:49:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:28 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 Jul 18 05:49:28 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-02808f45-aa71-427a-bd6d-679382f06c2f tempest-VolumesActionsTest-785566700 None] Acquiring lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" by "attach_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-02808f45-aa71-427a-bd6d-679382f06c2f tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" acquired by "attach_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:29 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-02808f45-aa71-427a-bd6d-679382f06c2f tempest-VolumesActionsTest-785566700 None] Attaching volume 4bc6992f-1923-4075-8fcc-45f8cd1cf28b to instance 7615ed0f-f5a9-4bb9-87fc-dd7cf8e68da1 at mountpoint /dev/vdb on host None. Jul 18 05:49:29 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-02808f45-aa71-427a-bd6d-679382f06c2f tempest-VolumesActionsTest-785566700 None] Attach volume completed successfully. Jul 18 05:49:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-02808f45-aa71-427a-bd6d-679382f06c2f tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" released by "attach_volume" :: held 0.125s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1c5081aa-b805-4ee8-a13d-44f674640560 tempest-VolumesActionsTest-785566700 None] Acquiring lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b-detach_volume" by "detach_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1c5081aa-b805-4ee8-a13d-44f674640560 tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:29 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1c5081aa-b805-4ee8-a13d-44f674640560 tempest-VolumesActionsTest-785566700 None] Detaching volume 4bc6992f-1923-4075-8fcc-45f8cd1cf28b from instance 7615ed0f-f5a9-4bb9-87fc-dd7cf8e68da1. Jul 18 05:49:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1c5081aa-b805-4ee8-a13d-44f674640560 tempest-VolumesActionsTest-785566700 None] Detach volume completed successfully. Jul 18 05:49:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1c5081aa-b805-4ee8-a13d-44f674640560 tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:30 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095" returned: 0 in 2.569s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:30 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_n8vapenmdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:49:30 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Converted 112.00 MB image at 43.58 MB/s Jul 18 05:49:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:30 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 1G Jul 18 05:49:30 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:31 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 1G" returned: 0 in 0.528s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Downloaded image 0d6393c9-e8a0-4628-b021-8c9aa5777656 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}])) to volume 99af4714-d141-47af-9902-a448c8675095 successfully. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Temporary image 0d6393c9-e8a0-4628-b021-8c9aa5777656 for user 9c6caf6c03ca4be192b2983062a21683 is deleted. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Marking volume 99af4714-d141-47af-9902-a448c8675095 as bootable. {{(pid=87497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Copying metadata from image 0d6393c9-e8a0-4628-b021-8c9aa5777656 to 99af4714-d141-47af-9902-a448c8675095. {{(pid=87497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Creating volume glance metadata for volume 99af4714-d141-47af-9902-a448c8675095 backed by image 0d6393c9-e8a0-4628-b021-8c9aa5777656 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b2f23e-359a-4c55-9626-9a198941050e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99af4714-d141-47af-9902-a448c8675095', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af0bcff-03db-4c21-95d6-606096555c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Volume volume-99af4714-d141-47af-9902-a448c8675095 (99af4714-d141-47af-9902-a448c8675095): created successfully Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af0bcff-03db-4c21-95d6-606096555c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (0d0c542d-7963-41d5-9d6d-48c61112a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8b03ebcf-1ed2-440a-a28a-5829d8d2f306 tempest-VolumesGetTest-993584081 None] Created volume successfully. Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (40172a24-837d-4f6e-af03-8166b8f4762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf3f791-0bca-4e8d-95ba-27581ebb21db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf3f791-0bca-4e8d-95ba-27581ebb21db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-586092404',display_name='tempest-VolumesGetTest-Volume-1034893022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3260334-0f29-4652-b576-6ef28b204da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:33Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1487be08-e873-4238-a2c9-0ddbbdf04f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1487be08-e873-4238-a2c9-0ddbbdf04f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df3fac1-fcbf-43fc-b6fb-8b3dc46f7959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df3fac1-fcbf-43fc-b6fb-8b3dc46f7959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3260334-0f29-4652-b576-6ef28b204da5', 'volume_name': 'volume-b3260334-0f29-4652-b576-6ef28b204da5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a1890b-4927-4198-9741-69b9f30787fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a1890b-4927-4198-9741-69b9f30787fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4b6fe1-92b5-4054-8d03-905b3713daa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Volume b3260334-0f29-4652-b576-6ef28b204da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3260334-0f29-4652-b576-6ef28b204da5', 'volume_size': 1} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-586092404',display_name='tempest-VolumesGetTest-Volume-1034893022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3260334-0f29-4652-b576-6ef28b204da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b51903d3534723a2a72684298e7166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:33Z,use_quota=True,user_id='9c6caf6c03ca4be192b2983062a21683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Creating volume b3260334-0f29-4652-b576-6ef28b204da5 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:49:32 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:49:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:32 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5 1073741824 Jul 18 05:49:32 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:33 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5 1073741824" returned: 0 in 0.518s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:33 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5 Jul 18 05:49:33 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:33 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5" returned: 0 in 0.278s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:49:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4b6fe1-92b5-4054-8d03-905b3713daa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3260334-0f29-4652-b576-6ef28b204da5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac251ebb-2abd-4d44-923b-bdee6a325f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:33 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Volume volume-b3260334-0f29-4652-b576-6ef28b204da5 (b3260334-0f29-4652-b576-6ef28b204da5): created successfully Jul 18 05:49:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac251ebb-2abd-4d44-923b-bdee6a325f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Flow 'volume_create_manager' (40172a24-837d-4f6e-af03-8166b8f4762b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-324f7c54-74f3-4f86-b263-819f26c73500 tempest-VolumesGetTest-993584081 None] Created volume successfully. Jul 18 05:49:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:34 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7278d214-7252-44a8-9baa-01000ca08b35]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:34 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b Jul 18 05:49:34 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-b3260334-0f29-4652-b576-6ef28b204da5-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:35 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" returned: 0 in 0.434s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Lock "cinder-b3260334-0f29-4652-b576-6ef28b204da5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[10845d84-5249-4ec4-9bab-a0ba9d61a64f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-quobyte-b3260334-0f29-4652-b576-6ef28b204da5" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-b3260334-0f29-4652-b576-6ef28b204da5" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af35f2b-aa72-482f-b54a-ca8bea6c1379]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:35 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b Jul 18 05:49:35 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:35 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5 Jul 18 05:49:35 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:35 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" returned: 0 in 0.374s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.2870cb95-1afe-4904-ac12-f73f1f8a51162dvltb_f.img {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:35 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.2870cb95-1afe-4904-ac12-f73f1f8a51162dvltb_f.img Jul 18 05:49:35 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:35 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5" returned: 0 in 0.414s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:35 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5 Jul 18 05:49:35 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:36 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b3260334-0f29-4652-b576-6ef28b204da5" returned: 0 in 0.558s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-b3260334-0f29-4652-b576-6ef28b204da5" released by "delete_volume" :: held 1.089s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Flow 'volume_create_manager' (c54d53a2-3c6f-41e3-9185-f38db4728246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e477ab3-8b81-4606-8afd-dd1bcdc1ae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e477ab3-8b81-4606-8afd-dd1bcdc1ae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1057759351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a2c18d-1589-41dd-81b2-431acfadd7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ccd9336d64f709cf3337c891c9a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:36Z,use_quota=True,user_id='9d1458e8480c468c9d3f7d544bc0bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1db19250-f809-44e2-b5dd-75caa199e6c0),volume_type_id=1db19250-f809-44e2-b5dd-75caa199e6c0)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30f5d2d-02a9-491d-b15e-1b3a53bf6446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30f5d2d-02a9-491d-b15e-1b3a53bf6446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccd81bd-43cf-48c3-86e9-a9b358a67c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccd81bd-43cf-48c3-86e9-a9b358a67c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a2c18d-1589-41dd-81b2-431acfadd7c5', 'volume_name': 'volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988db242-b1d0-4483-bad4-49f56a236d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988db242-b1d0-4483-bad4-49f56a236d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d55a6c-e352-4390-ae90-bcd5333e40a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:36 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Volume d0a2c18d-1589-41dd-81b2-431acfadd7c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5', 'volume_size': 1} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Created reservations ['67f60a88-9944-4f15-bac4-bf6435fde154', 'f6bc86b6-1603-48af-9754-4bb749a87713', '65ea483e-77ae-4173-a3aa-379b6b8d7723', 'ee1233af-68f8-48dc-bd23-c42d13b0c2e5'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:36 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:49:36 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:49:37 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Flow 'volume_create_manager' (c816df38-4f11-42b2-9f29-775bd7421ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9e4803-f498-49bc-90e9-1221d0d074b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.646s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:49:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Deleted volume successfully. Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9e4803-f498-49bc-90e9-1221d0d074b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1557299704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4c5d6a-a7a3-4ea8-8864-babc8f8363df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ccd9336d64f709cf3337c891c9a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:37Z,use_quota=True,user_id='9d1458e8480c468c9d3f7d544bc0bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a846a87-a386-4f1c-9bb0-1aad231e2c5f),volume_type_id=7a846a87-a386-4f1c-9bb0-1aad231e2c5f)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2396211-97e9-4d4f-ae17-ca868cf57e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2396211-97e9-4d4f-ae17-ca868cf57e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838d6651-ebe9-4d7a-8d22-04acb1df9e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838d6651-ebe9-4d7a-8d22-04acb1df9e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c4c5d6a-a7a3-4ea8-8864-babc8f8363df', 'volume_name': 'volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f52ffd0-9144-431f-9be7-154f24282b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f52ffd0-9144-431f-9be7-154f24282b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d48a53d-475e-4433-9c6e-5c9ac80e0df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:37 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Volume 8c4c5d6a-a7a3-4ea8-8864-babc8f8363df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df', 'volume_size': 1} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-99af4714-d141-47af-9902-a448c8675095-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-52c3fed2-2a1c-496b-a8f9-7197fbf4e241 tempest-VolumesGetTest-993584081 None] Lock "cinder-b3260334-0f29-4652-b576-6ef28b204da5-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Lock "cinder-99af4714-d141-47af-9902-a448c8675095-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Acquiring lock "cinder-quobyte-99af4714-d141-47af-9902-a448c8675095" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:49:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-99af4714-d141-47af-9902-a448c8675095" acquired by "delete_volume" :: waited 0.043s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:49:38 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[314d139c-2000-4182-bbc3-07b342f8ce2b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:38 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 Jul 18 05:49:38 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:39 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095" returned: 0 in 1.073s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:39 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095 Jul 18 05:49:39 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Flow 'volume_create_manager' (0bf80ba8-95bf-49f4-b1e6-52dc55eb135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290402a3-cf37-44b6-94b6-86d47aca1555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290402a3-cf37-44b6-94b6-86d47aca1555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-588322207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39d8f8b-2a64-4791-a930-b2e51fc3a179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ccd9336d64f709cf3337c891c9a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:39Z,use_quota=True,user_id='9d1458e8480c468c9d3f7d544bc0bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69bbaaa-2bed-492a-86f4-a1f7dc609c6e),volume_type_id=d69bbaaa-2bed-492a-86f4-a1f7dc609c6e)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3388b8d0-540f-45c0-9b34-a3f0b6f3ae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3388b8d0-540f-45c0-9b34-a3f0b6f3ae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39182406-3b80-4a0b-b9dc-be40eedafe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:39 devstack cinder-volume[87497]: DEBUG cinder.image.glance [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Creating Keystone auth plugin from conf {{(pid=87497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 05:49:39 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99af4714-d141-47af-9902-a448c8675095" returned: 0 in 0.849s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Lock "cinder-quobyte-99af4714-d141-47af-9902-a448c8675095" released by "delete_volume" :: held 2.041s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39182406-3b80-4a0b-b9dc-be40eedafe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd39d8f8b-2a64-4791-a930-b2e51fc3a179', 'volume_name': 'volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179', 'volume_size': 1, 'image_id': '5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1773640184', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc2ccd9336d64f709cf3337c891c9a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'created_at': datetime.datetime(2026, 7, 18, 3, 49, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 49, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6d5813-8875-4c76-aeef-e5a44d31e3e0/file', 'properties': {}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f81e0d-26ea-4b92-b28f-db28be4bfa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f81e0d-26ea-4b92-b28f-db28be4bfa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d2eb4-f00a-4d83-9953-818b325c199f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:49:40 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Volume d39d8f8b-2a64-4791-a930-b2e51fc3a179: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179', 'volume_size': 1, 'image_id': '5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1773640184', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc2ccd9336d64f709cf3337c891c9a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'created_at': datetime.datetime(2026, 7, 18, 3, 49, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 49, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6d5813-8875-4c76-aeef-e5a44d31e3e0/file', 'properties': {}}, 'image_service': } Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Trying to clone d39d8f8b-2a64-4791-a930-b2e51fc3a179 from image 5c6d5813-8875-4c76-aeef-e5a44d31e3e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'metadata': {}}]). {{(pid=87497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Created reservations ['fa505cf5-fe61-4158-a677-dbd223d6ac64', '9087a73b-f1fe-4349-8899-8eac70c2389c', 'e4a71966-eaef-4891-a001-be1b684afd28', 'e73a56fd-0d40-4638-a363-98be52f4a1a8'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:40 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:49:40 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:40 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.2870cb95-1afe-4904-ac12-f73f1f8a51162dvltb_f.img" returned: 0 in 5.368s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fec3768-c47f-48e2-a908-b16a9a1d4e78]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:40 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.340s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:49:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Deleted volume successfully. Jul 18 05:49:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c041603b-0602-4050-a09d-be105575092a tempest-VolumesGetTest-993584081 None] Lock "cinder-99af4714-d141-47af-9902-a448c8675095-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:49:41 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b Jul 18 05:49:41 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:41 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" returned: 0 in 0.548s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:41 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.2870cb95-1afe-4904-ac12-f73f1f8a51162dvltb_f.img {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:49:41 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Converted 1024.00 MB image at 190.72 MB/s Jul 18 05:49:41 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] 2870cb95-1afe-4904-ac12-f73f1f8a5116 was raw, no need to convert to raw {{(pid=87497) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 18 05:49:44 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD, size 20.69 MB, duration 4.13 sec {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 05:49:44 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Image download 20.69 MB at 5.01 MB/s Jul 18 05:49:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c25b5e5-d4a0-43c4-b69e-225803e48846]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:44 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD Jul 18 05:49:44 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:44 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:44 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Temporary image 5c6d5813-8875-4c76-aeef-e5a44d31e3e0 is fetched for user 9d1458e8480c468c9d3f7d544bc0bf66. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 05:49:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aacb936-5449-4dab-8d5b-dc7be34f36ea]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:49:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:49:45 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD Jul 18 05:49:45 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:49:45 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 18 05:49:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:49:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:49:54 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=56,cinder:SELECT=56,cinder:DELETE=9,cinder:INSERT=20 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:49:54 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=87,cinder:INSERT=26,cinder:UPDATE=106,cinder:DELETE=4 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.547s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Uploaded volume to glance image-id: 2870cb95-1afe-4904-ac12-f73f1f8a5116. {{(pid=87497) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.593s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1057759351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a2c18d-1589-41dd-81b2-431acfadd7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ccd9336d64f709cf3337c891c9a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:36Z,use_quota=True,user_id='9d1458e8480c468c9d3f7d544bc0bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1db19250-f809-44e2-b5dd-75caa199e6c0),volume_type_id=1db19250-f809-44e2-b5dd-75caa199e6c0)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Creating volume d0a2c18d-1589-41dd-81b2-431acfadd7c5 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:50:03 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:03 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 1073741824 Jul 18 05:50:03 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:03 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-3bdb56b1-54c4-4464-a9ad-62dd85e32890 tempest-VolumesActionsTest-785566700 None] Copy volume to image completed successfully. Jul 18 05:50:03 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 1073741824" returned: 0 in 0.478s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:03 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 Jul 18 05:50:03 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:04 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5" returned: 0 in 0.281s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.286s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1557299704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4c5d6a-a7a3-4ea8-8864-babc8f8363df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ccd9336d64f709cf3337c891c9a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:37Z,use_quota=True,user_id='9d1458e8480c468c9d3f7d544bc0bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a846a87-a386-4f1c-9bb0-1aad231e2c5f),volume_type_id=7a846a87-a386-4f1c-9bb0-1aad231e2c5f)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Creating volume 8c4c5d6a-a7a3-4ea8-8864-babc8f8363df {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:50:04 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d55a6c-e352-4390-ae90-bcd5333e40a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:04 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df 1073741824 Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4789287-7d66-48db-85a6-3bedeb328dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:04 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:04 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Volume volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 (d0a2c18d-1589-41dd-81b2-431acfadd7c5): created successfully Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4789287-7d66-48db-85a6-3bedeb328dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Flow 'volume_create_manager' (c54d53a2-3c6f-41e3-9185-f38db4728246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:50:04 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-fffebff4-24b3-4a08-94b9-19c18fb45b72 tempest-TestInstancesWithCinderVolumes-1240125727 None] Created volume successfully. Jul 18 05:50:04 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df 1073741824" returned: 0 in 0.546s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:04 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df Jul 18 05:50:04 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:04 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df" returned: 0 in 0.294s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.531s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-588322207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39d8f8b-2a64-4791-a930-b2e51fc3a179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ccd9336d64f709cf3337c891c9a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:49:39Z,use_quota=True,user_id='9d1458e8480c468c9d3f7d544bc0bf66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69bbaaa-2bed-492a-86f4-a1f7dc609c6e),volume_type_id=d69bbaaa-2bed-492a-86f4-a1f7dc609c6e)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Creating volume d39d8f8b-2a64-4791-a930-b2e51fc3a179 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:50:04 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d48a53d-475e-4433-9c6e-5c9ac80e0df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133e861f-00e9-4b49-9cd9-713ef432e3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:04 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 1073741824 Jul 18 05:50:04 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:04 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Volume volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df (8c4c5d6a-a7a3-4ea8-8864-babc8f8363df): created successfully Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133e861f-00e9-4b49-9cd9-713ef432e3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Flow 'volume_create_manager' (c816df38-4f11-42b2-9f29-775bd7421ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:50:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9842fd38-0480-4bdc-abb1-e030b542051b tempest-TestInstancesWithCinderVolumes-1240125727 None] Created volume successfully. Jul 18 05:50:05 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 1073741824" returned: 0 in 0.478s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:05 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 Jul 18 05:50:05 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:05 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179" returned: 0 in 0.251s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.946s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a0e542-939c-4ded-9d67-95b01346a9d4]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Attempting download of 5c6d5813-8875-4c76-aeef-e5a44d31e3e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'metadata': {}}])) to volume d39d8f8b-2a64-4791-a930-b2e51fc3a179. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b54cf2-366a-4bff-8e7c-28e30946181e]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_4zuo92rd {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:05 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b Jul 18 05:50:05 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:05 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_4zuo92rd Jul 18 05:50:05 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:06 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:06 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" returned: 0 in 0.449s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_4zuo92rd" returned: 0 in 0.367s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_4zuo92rd {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:06 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad90fab6-661a-4ff4-aa80-eb537a47dfba]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:06 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:06 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_4zuo92rd Jul 18 05:50:06 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:06 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b Jul 18 05:50:06 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:06 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.395s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:50:06 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_4zuo92rd" returned: 1 in 0.427s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_4zuo92rd' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f101d02b-7237-40db-8bd5-ded02bb64e34]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:06 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" returned: 0 in 0.517s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:06 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD Jul 18 05:50:06 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:06 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img Jul 18 05:50:06 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:06 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] 5c6d5813-8875-4c76-aeef-e5a44d31e3e0 was qcow2, converting to qcow2 {{(pid=87497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:07 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 Jul 18 05:50:07 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Flow 'volume_create_manager' (31cb3519-dc5e-471e-a32a-ec3183b08d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5400edb2-da18-4160-845d-3dfca5fbf522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5400edb2-da18-4160-845d-3dfca5fbf522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-968849325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3153da-c1e9-40c2-afb3-13ae2cb1e737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d86c16e120442aafb93ee85d02b51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:50:07Z,use_quota=True,user_id='1a11eb5d103c476b8b32855fce6f604e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeba2b3-97d9-491e-9cf4-379d041ce8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeba2b3-97d9-491e-9cf4-379d041ce8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6e0659-20fe-4bdc-af1a-5208ec92c5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:07 devstack cinder-volume[87497]: DEBUG cinder.image.glance [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Creating Keystone auth plugin from conf {{(pid=87497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 05:50:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6e0659-20fe-4bdc-af1a-5208ec92c5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed3153da-c1e9-40c2-afb3-13ae2cb1e737', 'volume_name': 'volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d007a693-e06d-46a3-9951-9856099b6d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d007a693-e06d-46a3-9951-9856099b6d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89f7250-43d7-4a59-9ece-911af8bc7201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:08 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Volume ed3153da-c1e9-40c2-afb3-13ae2cb1e737: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 18 05:50:08 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Trying to clone ed3153da-c1e9-40c2-afb3-13ae2cb1e737 from image 0d6393c9-e8a0-4628-b021-8c9aa5777656 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]). {{(pid=87497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 05:50:09 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 05:50:09 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Image download 20.69 MB at 20.69 MB/s Jul 18 05:50:09 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[956a1480-bcb1-4a71-a0d4-64a0ac4baf00]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:09 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD Jul 18 05:50:09 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:09 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD" returned: 0 in 0.610s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:09 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Temporary image 0d6393c9-e8a0-4628-b021-8c9aa5777656 is fetched for user 1a11eb5d103c476b8b32855fce6f604e. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 05:50:09 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5598e5e7-49f9-4195-b8b3-6b7060b4771e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:10 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD Jul 18 05:50:10 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:10 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD" returned: 0 in 0.746s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:10 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179" returned: 0 in 3.968s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:10 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c6d5813-8875-4c76-aeef-e5a44d31e3e0_ggwhb2sndevstack@QuobyteHD, size 112.00 MB, duration 3.97 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:50:10 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Converted 112.00 MB image at 28.22 MB/s Jul 18 05:50:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:11 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 1G Jul 18 05:50:11 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:11 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 1G" returned: 0 in 0.633s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Downloaded image 5c6d5813-8875-4c76-aeef-e5a44d31e3e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'metadata': {}}])) to volume d39d8f8b-2a64-4791-a930-b2e51fc3a179 successfully. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Temporary image 5c6d5813-8875-4c76-aeef-e5a44d31e3e0 for user 9d1458e8480c468c9d3f7d544bc0bf66 is deleted. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Marking volume d39d8f8b-2a64-4791-a930-b2e51fc3a179 as bootable. {{(pid=87497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Copying metadata from image 5c6d5813-8875-4c76-aeef-e5a44d31e3e0 to d39d8f8b-2a64-4791-a930-b2e51fc3a179. {{(pid=87497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Creating volume glance metadata for volume d39d8f8b-2a64-4791-a930-b2e51fc3a179 backed by image 5c6d5813-8875-4c76-aeef-e5a44d31e3e0 with: {'image_id': '5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'image_name': 'tempest-scenario-img--1773640184', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 05:50:11 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img" returned: 0 in 4.970s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e64fe5-bb68-49bd-8fa3-0e8415cc960a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d2eb4-f00a-4d83-9953-818b325c199f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179', 'volume_size': 1, 'image_id': '5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1773640184', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc2ccd9336d64f709cf3337c891c9a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6d5813-8875-4c76-aeef-e5a44d31e3e0', 'created_at': datetime.datetime(2026, 7, 18, 3, 49, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 49, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6d5813-8875-4c76-aeef-e5a44d31e3e0/file', 'properties': {}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fdee8ee-6d9e-49ba-97cf-559f559e7cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:11 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Volume volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 (d39d8f8b-2a64-4791-a930-b2e51fc3a179): created successfully Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fdee8ee-6d9e-49ba-97cf-559f559e7cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Flow 'volume_create_manager' (0bf80ba8-95bf-49f4-b1e6-52dc55eb135e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:50:11 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9b88dbe6-3c1d-412c-a924-6607aadf1ba3 tempest-TestInstancesWithCinderVolumes-1240125727 None] Created volume successfully. Jul 18 05:50:11 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b Jul 18 05:50:11 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:12 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" returned: 0 in 0.547s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:50:12 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Converted 1024.00 MB image at 206.00 MB/s Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] f031d6e5-fd7b-48c8-83aa-63b9921164a4 was raw, converting to qcow2 {{(pid=87497) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5d474f-e077-48fd-ab9a-583a815000a8]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:12 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img Jul 18 05:50:12 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:12 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:12 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img Jul 18 05:50:12 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:12 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img" returned: 1 in 0.335s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:50:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img /opt/stack/data/cinder/conversion/vol_upload_0dtftcyn {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:12 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img /opt/stack/data/cinder/conversion/vol_upload_0dtftcyn Jul 18 05:50:12 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:13 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img /opt/stack/data/cinder/conversion/vol_upload_0dtftcyn" returned: 0 in 0.310s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:13 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Image conversion details: src /opt/stack/data/cinder/conversion/4bc6992f-1923-4075-8fcc-45f8cd1cf28b.temp_image.f031d6e5-fd7b-48c8-83aa-63b9921164a4knj8_n6k.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_0dtftcyn {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:50:13 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 18 05:50:13 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e8faca-e56f-4634-9ee1-48900e8d0536]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0dtftcyn {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:13 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0dtftcyn Jul 18 05:50:13 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:13 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0dtftcyn" returned: 0 in 0.355s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-b0ce49bd-1f6d-4bc5-88b8-f24d6a223510 req-0384f221-9db0-4c43-8f01-49d233c9270c tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.584s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Uploaded volume to glance image-id: f031d6e5-fd7b-48c8-83aa-63b9921164a4. {{(pid=87497) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.660s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-968849325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3153da-c1e9-40c2-afb3-13ae2cb1e737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d86c16e120442aafb93ee85d02b51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:50:07Z,use_quota=True,user_id='1a11eb5d103c476b8b32855fce6f604e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Creating volume ed3153da-c1e9-40c2-afb3-13ae2cb1e737 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:50:15 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:15 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 1073741824 Jul 18 05:50:15 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:15 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-29e9af38-2c57-4529-9b6e-e1498ab88370 tempest-VolumesActionsTest-785566700 None] Copy volume to image completed successfully. Jul 18 05:50:15 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 1073741824" returned: 0 in 0.494s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:15 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 Jul 18 05:50:15 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:16 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737" returned: 0 in 0.266s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-b0ce49bd-1f6d-4bc5-88b8-f24d6a223510 req-0384f221-9db0-4c43-8f01-49d233c9270c tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.648s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-b0ce49bd-1f6d-4bc5-88b8-f24d6a223510 req-0384f221-9db0-4c43-8f01-49d233c9270c tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Attempting download of 0d6393c9-e8a0-4628-b021-8c9aa5777656 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}])) to volume ed3153da-c1e9-40c2-afb3-13ae2cb1e737. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-b0ce49bd-1f6d-4bc5-88b8-f24d6a223510 req-0384f221-9db0-4c43-8f01-49d233c9270c tempest-TestInstancesWithCinderVolumes-1240125727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '367046ba-ad49-42cf-9729-b49d4151e35c', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:50:16 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-b0ce49bd-1f6d-4bc5-88b8-f24d6a223510 req-0384f221-9db0-4c43-8f01-49d233c9270c tempest-TestInstancesWithCinderVolumes-1240125727 None] attachment_update completed successfully. Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7817cdf5-69a0-47ca-bb0a-995856f423f9]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_k312sys8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:16 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_k312sys8 Jul 18 05:50:16 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:16 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_k312sys8" returned: 0 in 0.502s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_k312sys8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:17 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_k312sys8 Jul 18 05:50:17 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:17 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_k312sys8" returned: 1 in 0.563s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d6393c9-e8a0-4628-b021-8c9aa5777656_k312sys8' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6270c153-a270-4aef-9542-d0140ef4f2b2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Acquiring lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:17 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD Jul 18 05:50:17 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Acquiring lock "cinder-quobyte-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Lock "cinder-quobyte-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4c0c08-9797-4166-8bcf-a9c55682118d]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:17 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] 0d6393c9-e8a0-4628-b021-8c9aa5777656 was qcow2, converting to qcow2 {{(pid=87497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 05:50:17 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b Jul 18 05:50:17 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:18 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 Jul 18 05:50:18 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:18 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" returned: 0 in 0.665s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:18 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b Jul 18 05:50:18 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:18 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" returned: 0 in 0.266s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Lock "cinder-quobyte-4bc6992f-1923-4075-8fcc-45f8cd1cf28b" released by "delete_volume" :: held 0.986s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Created reservations ['01c11d84-e871-42db-a43e-f3f168289ad0', '9133e830-10b8-4a4f-9d04-280d8bb58371', '48fa2b97-8164-4b41-b62b-3749616fc84b', 'df3636b0-e8db-44b9-94ef-1df05bbafa6d'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:18 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:50:18 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:19 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:19 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:50:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Deleted volume successfully. Jul 18 05:50:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e59972b1-465d-4615-8b57-5171dbe74509 tempest-VolumesActionsTest-785566700 None] Lock "cinder-4bc6992f-1923-4075-8fcc-45f8cd1cf28b-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:50:20 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737" returned: 0 in 2.381s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:20 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d6393c9-e8a0-4628-b021-8c9aa5777656_h98t2hm_devstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:50:20 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Converted 112.00 MB image at 47.01 MB/s Jul 18 05:50:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:20 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 1G Jul 18 05:50:20 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:20 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 1G" returned: 0 in 0.464s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:20 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Downloaded image 0d6393c9-e8a0-4628-b021-8c9aa5777656 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}])) to volume ed3153da-c1e9-40c2-afb3-13ae2cb1e737 successfully. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 05:50:20 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Temporary image 0d6393c9-e8a0-4628-b021-8c9aa5777656 for user 1a11eb5d103c476b8b32855fce6f604e is deleted. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 05:50:20 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Marking volume ed3153da-c1e9-40c2-afb3-13ae2cb1e737 as bootable. {{(pid=87497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 05:50:20 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Copying metadata from image 0d6393c9-e8a0-4628-b021-8c9aa5777656 to ed3153da-c1e9-40c2-afb3-13ae2cb1e737. {{(pid=87497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 05:50:20 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Creating volume glance metadata for volume ed3153da-c1e9-40c2-afb3-13ae2cb1e737 backed by image 0d6393c9-e8a0-4628-b021-8c9aa5777656 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 05:50:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89f7250-43d7-4a59-9ece-911af8bc7201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737', 'volume_size': 1, 'image_id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d6393c9-e8a0-4628-b021-8c9aa5777656', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8f7edb021ef4e41bf899c4d6d6dc175', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0d6393c9-e8a0-4628-b021-8c9aa5777656', 'created_at': datetime.datetime(2026, 7, 18, 3, 32, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 32, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d6393c9-e8a0-4628-b021-8c9aa5777656/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f256c9-0239-4a78-8f4b-0b76219f5b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Volume volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 (ed3153da-c1e9-40c2-afb3-13ae2cb1e737): created successfully Jul 18 05:50:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f256c9-0239-4a78-8f4b-0b76219f5b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Flow 'volume_create_manager' (31cb3519-dc5e-471e-a32a-ec3183b08d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:50:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-731edbcf-d0b7-4b4e-8759-51b1e53d74b3 tempest-TestShelveInstance-814580861 None] Created volume successfully. Jul 18 05:50:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-c627be15-0038-4e0a-b9b7-dc94ceea0f3e req-d72ecb92-0860-4486-824e-d5907b1062b8 tempest-TestShelveInstance-814580861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-c627be15-0038-4e0a-b9b7-dc94ceea0f3e req-d72ecb92-0860-4486-824e-d5907b1062b8 tempest-TestShelveInstance-814580861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-c627be15-0038-4e0a-b9b7-dc94ceea0f3e req-d72ecb92-0860-4486-824e-d5907b1062b8 tempest-TestShelveInstance-814580861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-c627be15-0038-4e0a-b9b7-dc94ceea0f3e req-d72ecb92-0860-4486-824e-d5907b1062b8 tempest-TestShelveInstance-814580861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4d4b617-ae82-452c-9fb5-81b8187ef594', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:50:28 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-c627be15-0038-4e0a-b9b7-dc94ceea0f3e req-d72ecb92-0860-4486-824e-d5907b1062b8 tempest-TestShelveInstance-814580861 None] attachment_update completed successfully. Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Flow 'volume_create_manager' (434b11b7-2ec8-4fd3-b4b1-d605c09f125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5442ae8d-cea2-44b2-9337-921a66334345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5442ae8d-cea2-44b2-9337-921a66334345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-911074285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c081dc95-b2cc-416f-a278-a490388c24c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8d70274ead45cf8c09d21081fe17f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:50:30Z,use_quota=True,user_id='fb559e71e6144c25bf328a52052384f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48317216-886d-4ca7-bd1b-5e7f45f8173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48317216-886d-4ca7-bd1b-5e7f45f8173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5538c5d9-6074-444b-8dfd-748446349b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5538c5d9-6074-444b-8dfd-748446349b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c081dc95-b2cc-416f-a278-a490388c24c7', 'volume_name': 'volume-c081dc95-b2cc-416f-a278-a490388c24c7', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e698cd-d916-465f-8d6d-b359716c87cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e698cd-d916-465f-8d6d-b359716c87cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9db22e9-c4dc-4f3f-ae95-c6cdf114a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:29 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Volume c081dc95-b2cc-416f-a278-a490388c24c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c081dc95-b2cc-416f-a278-a490388c24c7', 'volume_size': 1} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-911074285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c081dc95-b2cc-416f-a278-a490388c24c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8d70274ead45cf8c09d21081fe17f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:50:30Z,use_quota=True,user_id='fb559e71e6144c25bf328a52052384f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Creating volume c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:50:29 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:50:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:30 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 1073741824 Jul 18 05:50:30 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:30 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 1073741824" returned: 0 in 0.501s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:30 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 Jul 18 05:50:30 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:30 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7" returned: 0 in 0.350s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:50:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9db22e9-c4dc-4f3f-ae95-c6cdf114a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c081dc95-b2cc-416f-a278-a490388c24c7', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e815a9-b6ef-46cd-9036-51c99c9f2176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:30 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Volume volume-c081dc95-b2cc-416f-a278-a490388c24c7 (c081dc95-b2cc-416f-a278-a490388c24c7): created successfully Jul 18 05:50:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e815a9-b6ef-46cd-9036-51c99c9f2176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:30 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Flow 'volume_create_manager' (434b11b7-2ec8-4fd3-b4b1-d605c09f125c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:50:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-69c587c6-2892-4758-8841-ca4a912528dd tempest-VolumesCloneTest-841824163 None] Created volume successfully. Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Flow 'volume_create_manager' (ed13b95c-1b3d-4a88-901d-c0f02888c5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af103597-8cc5-4cde-b151-4411c8576110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af103597-8cc5-4cde-b151-4411c8576110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-771851799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88dff4c0-916b-4872-86c1-454e0c1cc5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba8d70274ead45cf8c09d21081fe17f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:50:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c081dc95-b2cc-416f-a278-a490388c24c7,status='creating',terminated_at=None,updated_at=2026-07-18T03:50:33Z,use_quota=True,user_id='fb559e71e6144c25bf328a52052384f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17450f1f-b404-4430-8d9a-1d787803f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17450f1f-b404-4430-8d9a-1d787803f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b53f0f-f026-4e07-af99-b0b13a3bc4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b53f0f-f026-4e07-af99-b0b13a3bc4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '88dff4c0-916b-4872-86c1-454e0c1cc5ea', 'volume_name': 'volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea', 'volume_size': 2, 'source_volid': 'c081dc95-b2cc-416f-a278-a490388c24c7', 'source_volstatus': 'available'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3bef23-1e3d-4055-b82f-733272cde02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3bef23-1e3d-4055-b82f-733272cde02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8af5824-a32c-4d7a-9a9d-30f38e9c72f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:33 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Volume 88dff4c0-916b-4872-86c1-454e0c1cc5ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea', 'volume_size': 2, 'source_volid': 'c081dc95-b2cc-416f-a278-a490388c24c7', 'source_volstatus': 'available'} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:33 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Cloning volume c081dc95-b2cc-416f-a278-a490388c24c7 to volume 88dff4c0-916b-4872-86c1-454e0c1cc5ea Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Creating offline snapshot 4db4de43-5355-47b8-9a74-c7b216360106 of volume c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5078272f-1828-4b56-913b-109567aabff9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:33 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 Jul 18 05:50:33 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:33 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7" returned: 0 in 0.512s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:33 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 1G Jul 18 05:50:33 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:34 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 1G" returned: 0 in 0.584s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c081dc95-b2cc-416f-a278-a490388c24c7 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:34 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c081dc95-b2cc-416f-a278-a490388c24c7 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 Jul 18 05:50:34 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:34 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c081dc95-b2cc-416f-a278-a490388c24c7 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106" returned: 0 in 0.414s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:34 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 is being set with open permissions: ugo+rw Jul 18 05:50:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:34 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 Jul 18 05:50:34 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:35 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106" returned: 0 in 0.344s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:35 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.info Jul 18 05:50:35 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:35 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.info" returned: 0 in 0.322s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:35 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.info is being set with open permissions: ugo+rw Jul 18 05:50:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:35 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.info Jul 18 05:50:35 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:35 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.info" returned: 0 in 0.324s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Acquiring lock "cinder-quobyte-88dff4c0-916b-4872-86c1-454e0c1cc5ea" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Lock "cinder-quobyte-88dff4c0-916b-4872-86c1-454e0c1cc5ea" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] snapshot: 4db4de43-5355-47b8-9a74-c7b216360106, volume: 88dff4c0-916b-4872-86c1-454e0c1cc5ea, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab9a38c-a4e4-401f-96d1-54038b87f944]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:36 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 Jul 18 05:50:36 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:36 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106" returned: 0 in 0.423s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c081dc95-b2cc-416f-a278-a490388c24c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c3e0fd-3448-4a4c-9e36-44bfbe8f8e8c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:36 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 Jul 18 05:50:36 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:36 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7" returned: 0 in 0.465s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:50:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:36 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea Jul 18 05:50:36 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:43 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea" returned: 0 in 6.762s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de407cb9-4eff-4885-831b-b07291d2cd77]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:43 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 Jul 18 05:50:43 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:44 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7" returned: 0 in 0.719s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:50:44 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Converted 1024.00 MB image at 151.40 MB/s Jul 18 05:50:44 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea is being set with open permissions: ugo+rw Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:44 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea Jul 18 05:50:44 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:44 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea" returned: 0 in 0.275s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Lock "cinder-quobyte-88dff4c0-916b-4872-86c1-454e0c1cc5ea" released by "_copy_volume_from_snapshot" :: held 8.758s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Acquiring lock "cinder-quobyte-4db4de43-5355-47b8-9a74-c7b216360106" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Lock "cinder-quobyte-4db4de43-5355-47b8-9a74-c7b216360106" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Deleting offline snapshot 4db4de43-5355-47b8-9a74-c7b216360106 of volume c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] snapshot_file for this snap is: volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7197feb0-ba69-4da2-913f-db33f1ee7b68]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:44 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 Jul 18 05:50:44 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:45 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106" returned: 0 in 0.416s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c081dc95-b2cc-416f-a278-a490388c24c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:50:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d58db1-9d9b-4af3-ba89-d08a5d73aeb8]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:45 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=46,cinder:UPDATE=30,cinder:INSERT=17,cinder:DELETE=2 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:50:45 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 Jul 18 05:50:45 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:45 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7" returned: 0 in 0.434s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:45 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 Jul 18 05:50:45 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:46 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106" returned: 0 in 0.384s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:46 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106 Jul 18 05:50:46 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:46 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7.4db4de43-5355-47b8-9a74-c7b216360106" returned: 0 in 0.264s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Lock "cinder-quobyte-4db4de43-5355-47b8-9a74-c7b216360106" released by "_delete_snapshot" :: held 1.594s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.099s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8af5824-a32c-4d7a-9a9d-30f38e9c72f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea', 'volume_size': 2, 'source_volid': 'c081dc95-b2cc-416f-a278-a490388c24c7', 'source_volstatus': 'available'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282e951e-3de1-4688-a743-e927b117b09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:50:46 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Volume volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea (88dff4c0-916b-4872-86c1-454e0c1cc5ea): created successfully Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282e951e-3de1-4688-a743-e927b117b09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Flow 'volume_create_manager' (ed13b95c-1b3d-4a88-901d-c0f02888c5a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:50:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a80685a0-761b-4cf4-8dca-44361f25260b tempest-VolumesCloneTest-841824163 None] Created volume successfully. Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Acquiring lock "cinder-88dff4c0-916b-4872-86c1-454e0c1cc5ea-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Lock "cinder-88dff4c0-916b-4872-86c1-454e0c1cc5ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Acquiring lock "cinder-quobyte-88dff4c0-916b-4872-86c1-454e0c1cc5ea" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Lock "cinder-quobyte-88dff4c0-916b-4872-86c1-454e0c1cc5ea" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1b1a6e-94b3-4c5f-a95a-a004a1a776ad]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:46 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea Jul 18 05:50:46 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:47 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea" returned: 0 in 0.360s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:47 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea Jul 18 05:50:47 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:47 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-88dff4c0-916b-4872-86c1-454e0c1cc5ea" returned: 0 in 0.265s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Lock "cinder-quobyte-88dff4c0-916b-4872-86c1-454e0c1cc5ea" released by "delete_volume" :: held 0.665s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Created reservations ['c29e964c-4f09-4b24-ada7-47466987cb54', 'ead7be3c-6934-4bd1-a4e9-0c0ca47ac1c2', '9ef13525-eee7-4d0d-9b3d-6c9cdb856af9', '4b09af76-ff42-4ec0-84ba-bab2a2a002d0'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:47 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:50:47 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:47 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.259s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:50:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Deleted volume successfully. Jul 18 05:50:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1b3e4935-3539-4e37-952e-48896bdd3a03 tempest-VolumesCloneTest-841824163 None] Lock "cinder-88dff4c0-916b-4872-86c1-454e0c1cc5ea-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Acquiring lock "cinder-c081dc95-b2cc-416f-a278-a490388c24c7-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Lock "cinder-c081dc95-b2cc-416f-a278-a490388c24c7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Acquiring lock "cinder-quobyte-c081dc95-b2cc-416f-a278-a490388c24c7" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Lock "cinder-quobyte-c081dc95-b2cc-416f-a278-a490388c24c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e78648-f924-492b-89f4-17e8613d5000]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:48 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 Jul 18 05:50:48 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:48 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7" returned: 0 in 0.391s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:48 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7 Jul 18 05:50:48 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:48 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c081dc95-b2cc-416f-a278-a490388c24c7" returned: 0 in 0.284s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Lock "cinder-quobyte-c081dc95-b2cc-416f-a278-a490388c24c7" released by "delete_volume" :: held 0.741s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Created reservations ['0491d06d-29e0-4b62-943a-26f68fafca9e', '276c1f54-0bff-4be9-98da-57ca26667743', 'd711fb15-07e3-40b5-b8eb-16cfb7d27488', 'fd9aa057-e486-4631-bf50-75d031a83a4c'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:49 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:50:49 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:49 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.313s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:50:49 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Deleted volume successfully. Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8384de6-012e-417d-bd8c-e1b992a6decb tempest-VolumesCloneTest-841824163 None] Lock "cinder-c081dc95-b2cc-416f-a278-a490388c24c7-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-fa4655f4-cfa0-4aac-8aa9-3572fb2b1728 req-5166b71b-6a26-4115-bce3-674668347cf9 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-fa4655f4-cfa0-4aac-8aa9-3572fb2b1728 req-5166b71b-6a26-4115-bce3-674668347cf9 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-fa4655f4-cfa0-4aac-8aa9-3572fb2b1728 req-5166b71b-6a26-4115-bce3-674668347cf9 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-fa4655f4-cfa0-4aac-8aa9-3572fb2b1728 req-5166b71b-6a26-4115-bce3-674668347cf9 tempest-TestInstancesWithCinderVolumes-1240125727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2b8794a-4a4a-4889-901c-e98975bf47cd', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:50:49 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-fa4655f4-cfa0-4aac-8aa9-3572fb2b1728 req-5166b71b-6a26-4115-bce3-674668347cf9 tempest-TestInstancesWithCinderVolumes-1240125727 None] attachment_update completed successfully. Jul 18 05:50:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-39d47430-00f4-4463-9447-24638ccfa2be req-f21352b8-d446-46c7-894c-08d6a30363fb tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-39d47430-00f4-4463-9447-24638ccfa2be req-f21352b8-d446-46c7-894c-08d6a30363fb tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-39d47430-00f4-4463-9447-24638ccfa2be req-f21352b8-d446-46c7-894c-08d6a30363fb tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:52 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-39d47430-00f4-4463-9447-24638ccfa2be req-f21352b8-d446-46c7-894c-08d6a30363fb tempest-TestInstancesWithCinderVolumes-1240125727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b1a47e6-86af-4531-a31d-0844b65e8e7c', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:50:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-39d47430-00f4-4463-9447-24638ccfa2be req-f21352b8-d446-46c7-894c-08d6a30363fb tempest-TestInstancesWithCinderVolumes-1240125727 None] attachment_update completed successfully. Jul 18 05:50:57 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=50,cinder:SELECT=63,cinder:DELETE=6,cinder:INSERT=20 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:50:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-50ca43b5-bfa4-4bb6-866e-a11462fcf5f1 req-2435b948-58d0-43ab-9fb6-49281575a126 tempest-TestInstancesWithCinderVolumes-1240125727 None] Terminate volume connection completed successfully. Jul 18 05:50:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-50ca43b5-bfa4-4bb6-866e-a11462fcf5f1 req-2435b948-58d0-43ab-9fb6-49281575a126 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deleting attachment a2b8794a-4a4a-4889-901c-e98975bf47cd. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:50:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "cinder-d0a2c18d-1589-41dd-81b2-431acfadd7c5-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-d0a2c18d-1589-41dd-81b2-431acfadd7c5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "cinder-quobyte-d0a2c18d-1589-41dd-81b2-431acfadd7c5" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:50:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-quobyte-d0a2c18d-1589-41dd-81b2-431acfadd7c5" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:50:58 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[79548469-1049-490a-a3b8-5d90ede2936f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:50:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:58 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 Jul 18 05:50:58 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:59 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5" returned: 0 in 0.488s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:59 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5 Jul 18 05:50:59 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:59 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d0a2c18d-1589-41dd-81b2-431acfadd7c5" returned: 0 in 0.476s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-quobyte-d0a2c18d-1589-41dd-81b2-431acfadd7c5" released by "delete_volume" :: held 1.021s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:50:59 devstack cinder-volume[87497]: WARNING cinder.quota [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1864872925-1163317717 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1864872925-1163317717, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:50:59 devstack cinder-volume[87497]: WARNING cinder.quota [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1864872925-1163317717 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1864872925-1163317717, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Created reservations ['a2e0a5d9-ed1d-4120-a015-4ab9eab78a11', 'b3f8db93-ccce-41d2-b481-56c3e8e6115d', 'c2aaa354-d045-4a0e-8e4c-547834cfdc58', '65c6b19b-de53-4743-b6dc-e73fd69def76'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:50:59 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:50:59 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:50:59 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.290s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:50:59 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:51:00 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deleted volume successfully. Jul 18 05:51:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6dae9eac-7b6f-48a6-9cf5-dc80ff36ef44 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-d0a2c18d-1589-41dd-81b2-431acfadd7c5-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:51:01 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-93f4d910-746d-4a55-be1d-dcafa940ae1a req-1febbbe0-0444-4f36-9ec7-ddeaf33d70fa tempest-TestShelveInstance-814580861 None] Terminate volume connection completed successfully. Jul 18 05:51:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-93f4d910-746d-4a55-be1d-dcafa940ae1a req-1febbbe0-0444-4f36-9ec7-ddeaf33d70fa tempest-TestShelveInstance-814580861 None] Deleting attachment f4d4b617-ae82-452c-9fb5-81b8187ef594. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:51:03 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-6196f8bc-20e8-4f96-bccb-f7f86954a023 req-a211f679-3c0d-4fbe-8cdc-563b3fae0dc0 tempest-TestInstancesWithCinderVolumes-1240125727 None] Terminate volume connection completed successfully. Jul 18 05:51:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-6196f8bc-20e8-4f96-bccb-f7f86954a023 req-a211f679-3c0d-4fbe-8cdc-563b3fae0dc0 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deleting attachment 4b1a47e6-86af-4531-a31d-0844b65e8e7c. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:51:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "cinder-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:51:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:51:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "cinder-quobyte-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:51:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-quobyte-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:51:03 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a0754a-2d5f-4fdd-95fb-7df555742c50]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:51:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:04 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df Jul 18 05:51:04 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-2962c443-1bc2-4026-8f28-43895f9624b9 req-3c60edf0-80c2-4152-926f-e9297f651e56 tempest-TestShelveInstance-814580861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-2962c443-1bc2-4026-8f28-43895f9624b9 req-3c60edf0-80c2-4152-926f-e9297f651e56 tempest-TestShelveInstance-814580861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-2962c443-1bc2-4026-8f28-43895f9624b9 req-3c60edf0-80c2-4152-926f-e9297f651e56 tempest-TestShelveInstance-814580861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-2962c443-1bc2-4026-8f28-43895f9624b9 req-3c60edf0-80c2-4152-926f-e9297f651e56 tempest-TestShelveInstance-814580861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07641bb5-b2b8-4fbe-9473-6c57d40d3035', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:51:04 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-2962c443-1bc2-4026-8f28-43895f9624b9 req-3c60edf0-80c2-4152-926f-e9297f651e56 tempest-TestShelveInstance-814580861 None] attachment_update completed successfully. Jul 18 05:51:04 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df" returned: 0 in 0.560s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:04 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df Jul 18 05:51:04 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:04 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df" returned: 0 in 0.331s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-quobyte-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df" released by "delete_volume" :: held 0.965s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:51:04 devstack cinder-volume[87497]: WARNING cinder.quota [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-189557193-767674828 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-189557193-767674828, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:51:04 devstack cinder-volume[87497]: WARNING cinder.quota [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-189557193-767674828 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-189557193-767674828, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:51:04 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Created reservations ['d143a7c6-79aa-498c-8a52-276a5377d361', '878f122f-8eef-4c90-b247-865d8b057d60', '92975cd0-2767-472f-b61c-6a002bd48db2', 'fa621923-a78e-422f-b1c5-fc9655faf6f9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:51:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:51:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:51:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:05 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:51:05 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:05 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.329s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:05 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:51:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deleted volume successfully. Jul 18 05:51:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-44ed6918-19b0-4e4f-8893-5a029b788832 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-8c4c5d6a-a7a3-4ea8-8864-babc8f8363df-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:06 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:51:06 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:06 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:51:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:51:10 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-6c585342-2030-4ec2-b1ab-22f405273cf4 req-b4e4a424-8019-4a7a-a616-3e30246032db tempest-TestInstancesWithCinderVolumes-1240125727 None] Terminate volume connection completed successfully. Jul 18 05:51:10 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-6c585342-2030-4ec2-b1ab-22f405273cf4 req-b4e4a424-8019-4a7a-a616-3e30246032db tempest-TestInstancesWithCinderVolumes-1240125727 None] Deleting attachment 367046ba-ad49-42cf-9729-b49d4151e35c. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:51:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "cinder-d39d8f8b-2a64-4791-a930-b2e51fc3a179-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:51:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-d39d8f8b-2a64-4791-a930-b2e51fc3a179-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:51:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "cinder-quobyte-d39d8f8b-2a64-4791-a930-b2e51fc3a179" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:51:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-quobyte-d39d8f8b-2a64-4791-a930-b2e51fc3a179" acquired by "delete_volume" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:51:12 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76c4e83-871b-4237-9470-3946c7eb3017]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:51:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:12 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 Jul 18 05:51:12 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:12 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179" returned: 0 in 0.666s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:12 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179 Jul 18 05:51:12 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:13 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d39d8f8b-2a64-4791-a930-b2e51fc3a179" returned: 0 in 0.336s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-quobyte-d39d8f8b-2a64-4791-a930-b2e51fc3a179" released by "delete_volume" :: held 1.088s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:51:13 devstack cinder-volume[87497]: WARNING cinder.quota [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1699458103-1886986344 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1699458103-1886986344, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:51:13 devstack cinder-volume[87497]: WARNING cinder.quota [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1699458103-1886986344 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1699458103-1886986344, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Created reservations ['f63ae110-e92a-48ca-8b09-9601ec1b52d6', '01bdb7e6-00d9-474a-9960-0778bf647e60', '69a70837-d789-4395-9462-ed20956270b6', '043ed2db-9139-4478-b5d0-054e34023790'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:13 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:51:13 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:13 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.365s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:51:13 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Deleted volume successfully. Jul 18 05:51:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ae950b52-b16e-46df-b5bd-9bac2fb33b15 tempest-TestInstancesWithCinderVolumes-1240125727 None] Lock "cinder-d39d8f8b-2a64-4791-a930-b2e51fc3a179-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:51:31 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=31,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:51:31 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=56,cinder:INSERT=9,cinder:SELECT=47,cinder:DELETE=3 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Flow 'volume_create_manager' (218eb5fb-fda1-4db4-8e31-4582bfdc6fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ad638c-8243-4b87-a89c-314506df4c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ad638c-8243-4b87-a89c-314506df4c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-141741716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a0b236-1185-471b-97a6-dffd0975ecc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6e5e7a210b4c17968ef6dbbd196dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:51:33Z,use_quota=True,user_id='c5f08180171a49b2ad5a5e46312cd7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa1ee57-5903-4891-8211-eae7ff1203bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa1ee57-5903-4891-8211-eae7ff1203bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71506d8d-481f-4f8d-8e5b-26693308e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71506d8d-481f-4f8d-8e5b-26693308e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a0b236-1185-471b-97a6-dffd0975ecc4', 'volume_name': 'volume-42a0b236-1185-471b-97a6-dffd0975ecc4', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86998d3d-34b5-4dc8-9029-642900047b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86998d3d-34b5-4dc8-9029-642900047b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc6ad86-1ea5-4d7a-8616-818bfe3a3018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Volume 42a0b236-1185-471b-97a6-dffd0975ecc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a0b236-1185-471b-97a6-dffd0975ecc4', 'volume_size': 1} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-141741716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a0b236-1185-471b-97a6-dffd0975ecc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6e5e7a210b4c17968ef6dbbd196dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:51:33Z,use_quota=True,user_id='c5f08180171a49b2ad5a5e46312cd7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Creating volume 42a0b236-1185-471b-97a6-dffd0975ecc4 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:51:32 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:51:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:33 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4 1073741824 Jul 18 05:51:33 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:33 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4 1073741824" returned: 0 in 0.581s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:33 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4 Jul 18 05:51:33 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:33 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4" returned: 0 in 0.368s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:51:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc6ad86-1ea5-4d7a-8616-818bfe3a3018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a0b236-1185-471b-97a6-dffd0975ecc4', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5927405b-589f-45ad-97cc-6a6f6196d9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:34 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Volume volume-42a0b236-1185-471b-97a6-dffd0975ecc4 (42a0b236-1185-471b-97a6-dffd0975ecc4): created successfully Jul 18 05:51:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5927405b-589f-45ad-97cc-6a6f6196d9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Flow 'volume_create_manager' (218eb5fb-fda1-4db4-8e31-4582bfdc6fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:51:34 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2e057020-8863-4912-93b4-1fbd9a4e0453 tempest-TestMinimumBasicScenario-1542347796 None] Created volume successfully. Jul 18 05:51:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-5b907b57-8b91-4ef9-baee-75a09b125c2d req-39fe61bb-bdf7-409e-bd7c-a16a822b8833 tempest-TestMinimumBasicScenario-1542347796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-5b907b57-8b91-4ef9-baee-75a09b125c2d req-39fe61bb-bdf7-409e-bd7c-a16a822b8833 tempest-TestMinimumBasicScenario-1542347796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-5b907b57-8b91-4ef9-baee-75a09b125c2d req-39fe61bb-bdf7-409e-bd7c-a16a822b8833 tempest-TestMinimumBasicScenario-1542347796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-5b907b57-8b91-4ef9-baee-75a09b125c2d req-39fe61bb-bdf7-409e-bd7c-a16a822b8833 tempest-TestMinimumBasicScenario-1542347796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-42a0b236-1185-471b-97a6-dffd0975ecc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c34a399-5d2b-439f-8d74-b4601cd019cf', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:51:36 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-5b907b57-8b91-4ef9-baee-75a09b125c2d req-39fe61bb-bdf7-409e-bd7c-a16a822b8833 tempest-TestMinimumBasicScenario-1542347796 None] attachment_update completed successfully. Jul 18 05:51:46 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:51:46 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Flow 'volume_create_manager' (c40c0983-2499-4e70-921b-e472fe1c9469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca58432a-8ec2-4015-96dc-769d301cc613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca58432a-8ec2-4015-96dc-769d301cc613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1525360747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d522973-6e0f-4f9d-9845-307518f6685d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2f1718f58549a3bf68239e4f052542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:51:55Z,use_quota=True,user_id='9284b8cfa1284691b45e86a980723a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e647434-d358-4337-a6c5-2d3359f16f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e647434-d358-4337-a6c5-2d3359f16f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4726e34-ea7f-450c-b994-9f9591e05281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4726e34-ea7f-450c-b994-9f9591e05281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d522973-6e0f-4f9d-9845-307518f6685d', 'volume_name': 'volume-1d522973-6e0f-4f9d-9845-307518f6685d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4fd906-5e9c-4bd7-8951-a43e2a16517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4fd906-5e9c-4bd7-8951-a43e2a16517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6544436-391f-4387-8862-66e06e218284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:54 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Volume 1d522973-6e0f-4f9d-9845-307518f6685d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d522973-6e0f-4f9d-9845-307518f6685d', 'volume_size': 1} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1525360747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d522973-6e0f-4f9d-9845-307518f6685d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2f1718f58549a3bf68239e4f052542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:51:55Z,use_quota=True,user_id='9284b8cfa1284691b45e86a980723a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Creating volume 1d522973-6e0f-4f9d-9845-307518f6685d {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:51:54 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:54 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d 1073741824 Jul 18 05:51:54 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:54 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-1582e8b0-ce1f-450f-a9e8-5efba54e18ef tempest-TestShelveInstance-814580861 None] Terminate volume connection completed successfully. Jul 18 05:51:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-1582e8b0-ce1f-450f-a9e8-5efba54e18ef tempest-TestShelveInstance-814580861 None] Deleting attachment 07641bb5-b2b8-4fbe-9473-6c57d40d3035. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Flow 'volume_create_manager' (dc92d172-dd0c-41f1-8388-19e3f13fd03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebc94ff-2493-4ee0-abc9-eba840aa7cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Acquiring lock "cinder-ed3153da-c1e9-40c2-afb3-13ae2cb1e737-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebc94ff-2493-4ee0-abc9-eba840aa7cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1521521807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e296df26-9b24-4e31-9319-133ee3cd84bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2f1718f58549a3bf68239e4f052542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:51:55Z,use_quota=True,user_id='9284b8cfa1284691b45e86a980723a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44cd445-dd5b-4e8c-a01f-eeda68af7db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44cd445-dd5b-4e8c-a01f-eeda68af7db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0120b033-413d-44c8-b312-961787b9cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0120b033-413d-44c8-b312-961787b9cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e296df26-9b24-4e31-9319-133ee3cd84bf', 'volume_name': 'volume-e296df26-9b24-4e31-9319-133ee3cd84bf', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea32543-e465-4f52-a4cb-62631612f408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea32543-e465-4f52-a4cb-62631612f408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3389bf2-aba4-4cc5-b338-8b1740f26ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:55 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Volume e296df26-9b24-4e31-9319-133ee3cd84bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e296df26-9b24-4e31-9319-133ee3cd84bf', 'volume_size': 1} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Lock "cinder-ed3153da-c1e9-40c2-afb3-13ae2cb1e737-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Acquiring lock "cinder-quobyte-ed3153da-c1e9-40c2-afb3-13ae2cb1e737" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Lock "cinder-quobyte-ed3153da-c1e9-40c2-afb3-13ae2cb1e737" acquired by "delete_volume" :: waited 0.037s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb8d8b5-27e3-4f51-99b0-ae2dbb06bb4b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:55 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d 1073741824" returned: 0 in 0.651s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:55 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d Jul 18 05:51:55 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:55 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 Jul 18 05:51:55 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:55 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d" returned: 0 in 0.308s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1521521807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e296df26-9b24-4e31-9319-133ee3cd84bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2f1718f58549a3bf68239e4f052542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:51:55Z,use_quota=True,user_id='9284b8cfa1284691b45e86a980723a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Creating volume e296df26-9b24-4e31-9319-133ee3cd84bf {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:51:55 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:55 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6544436-391f-4387-8862-66e06e218284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d522973-6e0f-4f9d-9845-307518f6685d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:55 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf 1073741824 Jul 18 05:51:55 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6def9f-e1f3-447b-81c9-b16acc07c4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737" returned: 0 in 0.499s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:55 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Volume volume-1d522973-6e0f-4f9d-9845-307518f6685d (1d522973-6e0f-4f9d-9845-307518f6685d): created successfully Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6def9f-e1f3-447b-81c9-b16acc07c4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Flow 'volume_create_manager' (c40c0983-2499-4e70-921b-e472fe1c9469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:51:55 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737 Jul 18 05:51:55 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-27b9dcb9-ee38-473a-bfa0-8e54f43ec19d tempest-TestServerVolumeAttachmentScenario-758707733 None] Created volume successfully. Jul 18 05:51:56 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ed3153da-c1e9-40c2-afb3-13ae2cb1e737" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Lock "cinder-quobyte-ed3153da-c1e9-40c2-afb3-13ae2cb1e737" released by "delete_volume" :: held 0.902s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.quota [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Created reservations ['d5d652ec-4152-4817-9565-e51ad20a1f6b', '1395d3a4-068e-4ce9-9515-a98933458924', 'a608aa99-425a-4a79-88c6-0fcff7118d97', '4f58e853-6f97-491d-aed7-ca4073ed4f97'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:56 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf 1073741824" returned: 0 in 0.548s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:56 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:51:56 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:56 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf Jul 18 05:51:56 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:56 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.282s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.manager [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:51:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Deleted volume successfully. Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [req-cacb308e-0b98-41c5-b871-f1b1d117c2c6 req-16e3b6ff-7e83-437a-afdd-0194f92f552b tempest-TestShelveInstance-814580861 None] Lock "cinder-ed3153da-c1e9-40c2-afb3-13ae2cb1e737-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:51:56 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf" returned: 0 in 0.312s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3389bf2-aba4-4cc5-b338-8b1740f26ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e296df26-9b24-4e31-9319-133ee3cd84bf', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f25dd7-cdf9-4fcb-9756-da95a18c10a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:51:56 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Volume volume-e296df26-9b24-4e31-9319-133ee3cd84bf (e296df26-9b24-4e31-9319-133ee3cd84bf): created successfully Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f25dd7-cdf9-4fcb-9756-da95a18c10a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:51:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Flow 'volume_create_manager' (dc92d172-dd0c-41f1-8388-19e3f13fd03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:51:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f043e7c5-b944-4079-8f21-070d183ca52b tempest-TestServerVolumeAttachmentScenario-758707733 None] Created volume successfully. Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:06 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:06 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:06 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.527s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=7,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:52:06 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=13,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (848a61ab-c230-45d2-974b-bf630f6932ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6006437-470f-4d8c-b931-9d31ef2c249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6006437-470f-4d8c-b931-9d31ef2c249e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1939904332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f058ae1e-7ca6-4e46-ae72-9a581ccaecdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:11Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679fe7d8-3426-4907-868c-6146602259aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679fe7d8-3426-4907-868c-6146602259aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8ebe00-7b56-45ee-a9c8-ac8766cc171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8ebe00-7b56-45ee-a9c8-ac8766cc171f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f058ae1e-7ca6-4e46-ae72-9a581ccaecdf', 'volume_name': 'volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eb6b14-9e3d-43b6-beaf-3c6f6d6ec6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eb6b14-9e3d-43b6-beaf-3c6f6d6ec6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b8ca99-0324-4b22-886a-2dcf8936ce62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:11 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Volume f058ae1e-7ca6-4e46-ae72-9a581ccaecdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf', 'volume_size': 1} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1939904332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f058ae1e-7ca6-4e46-ae72-9a581ccaecdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:11Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Creating volume f058ae1e-7ca6-4e46-ae72-9a581ccaecdf {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:11 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:11 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf 1073741824 Jul 18 05:52:11 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (b01862d1-8445-4cdd-8734-a5a2cff85547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faba020-e441-4749-abfb-21522bcff96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faba020-e441-4749-abfb-21522bcff96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-194347585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d8c013-6948-4916-8c75-9d026b6d0cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:12Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e278f49f-a6fd-4f8b-954c-b152870f55fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e278f49f-a6fd-4f8b-954c-b152870f55fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef81ab3-5a46-4149-a7d0-9c1b1e5ce823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef81ab3-5a46-4149-a7d0-9c1b1e5ce823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d8c013-6948-4916-8c75-9d026b6d0cdf', 'volume_name': 'volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad801da5-d8e5-4b26-841c-097c5fcf98b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad801da5-d8e5-4b26-841c-097c5fcf98b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ecff89-81c1-43ea-8e54-1f1808620212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Volume e4d8c013-6948-4916-8c75-9d026b6d0cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf', 'volume_size': 1} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:12 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf 1073741824" returned: 0 in 0.689s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:12 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf Jul 18 05:52:12 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (591997bb-a86d-41e6-801c-bc12858b4f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29332736-de01-425c-b692-ceec5723a3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29332736-de01-425c-b692-ceec5723a3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-375255185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7d66cc-51d7-4593-8a34-753a534060b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:12Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da80f43e-2f8f-493a-8a96-9a3b7a8ee890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da80f43e-2f8f-493a-8a96-9a3b7a8ee890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5969f24-0044-4c03-9a64-c1792210af8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5969f24-0044-4c03-9a64-c1792210af8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f7d66cc-51d7-4593-8a34-753a534060b3', 'volume_name': 'volume-8f7d66cc-51d7-4593-8a34-753a534060b3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d2ed87-6b9f-432d-baee-40501e4fcb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d2ed87-6b9f-432d-baee-40501e4fcb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7aa7a0-b447-4482-ac9c-e2328da5f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:12 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Volume 8f7d66cc-51d7-4593-8a34-753a534060b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f7d66cc-51d7-4593-8a34-753a534060b3', 'volume_size': 1} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf" returned: 0 in 0.517s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-194347585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d8c013-6948-4916-8c75-9d026b6d0cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:12Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Creating volume e4d8c013-6948-4916-8c75-9d026b6d0cdf {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:13 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:13 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf 1073741824 Jul 18 05:52:13 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b8ca99-0324-4b22-886a-2dcf8936ce62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be37e7f6-f4cc-4feb-a367-855691c3219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (25424bf9-13eb-4165-9be1-2efa8fb41233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eba4a3b-cb5a-4827-9892-66b3f7fa4c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Volume volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf (f058ae1e-7ca6-4e46-ae72-9a581ccaecdf): created successfully Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be37e7f6-f4cc-4feb-a367-855691c3219a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (848a61ab-c230-45d2-974b-bf630f6932ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eba4a3b-cb5a-4827-9892-66b3f7fa4c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2091532015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5aabc9-e82f-4b40-82af-848dec5cfe24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:13Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685c238f-7c13-45a7-8beb-a0e7fdffaf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685c238f-7c13-45a7-8beb-a0e7fdffaf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18b03db-d67c-4bd2-8721-009a486a537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18b03db-d67c-4bd2-8721-009a486a537f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5aabc9-e82f-4b40-82af-848dec5cfe24', 'volume_name': 'volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c085866-5195-426e-98a3-15a9cfdb6feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c085866-5195-426e-98a3-15a9cfdb6feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a97a4d-c082-4dee-93d9-d9fad9fdf796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Volume 4a5aabc9-e82f-4b40-82af-848dec5cfe24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24', 'volume_size': 1} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:13 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-418861d1-f733-4874-a1d0-ef97c6c435c7 tempest-CreateVolumesFromImageTest-1589528221 None] Created volume successfully. Jul 18 05:52:13 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf 1073741824" returned: 0 in 0.679s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:13 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf Jul 18 05:52:13 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (4fe3d2e4-c2d8-4dbb-9e20-f9ec6f511c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1421a4e7-fbec-4c41-9ad1-c080948b84b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1421a4e7-fbec-4c41-9ad1-c080948b84b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020098766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c268832-a660-4187-8263-5b234362a6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:14Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3723dfc8-67fd-4d0c-bf89-4a7e6b886ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3723dfc8-67fd-4d0c-bf89-4a7e6b886ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cad5059-4254-4b1e-a1de-faa135f1a7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cad5059-4254-4b1e-a1de-faa135f1a7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c268832-a660-4187-8263-5b234362a6c3', 'volume_name': 'volume-3c268832-a660-4187-8263-5b234362a6c3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10462aa1-cec7-483b-84d3-c0e68795210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10462aa1-cec7-483b-84d3-c0e68795210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1057ec-6586-41bc-a7e0-6cc23dc78e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:13 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Volume 3c268832-a660-4187-8263-5b234362a6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c268832-a660-4187-8263-5b234362a6c3', 'volume_size': 1} Jul 18 05:52:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:14 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf" returned: 0 in 0.331s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-375255185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7d66cc-51d7-4593-8a34-753a534060b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:12Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Creating volume 8f7d66cc-51d7-4593-8a34-753a534060b3 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:14 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ecff89-81c1-43ea-8e54-1f1808620212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8eaca4-e72b-4bfb-b9a7-228ade9d2281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:14 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3 1073741824 Jul 18 05:52:14 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:14 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Volume volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf (e4d8c013-6948-4916-8c75-9d026b6d0cdf): created successfully Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8eaca4-e72b-4bfb-b9a7-228ade9d2281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (b01862d1-8445-4cdd-8734-a5a2cff85547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1fc3aeb1-c6a7-4d14-8680-bba346a76edc tempest-CreateVolumesFromImageTest-1589528221 None] Created volume successfully. Jul 18 05:52:14 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3 1073741824" returned: 0 in 0.492s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:14 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3 Jul 18 05:52:14 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:14 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3" returned: 0 in 0.268s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.632s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2091532015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5aabc9-e82f-4b40-82af-848dec5cfe24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:13Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Creating volume 4a5aabc9-e82f-4b40-82af-848dec5cfe24 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:14 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:14 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 1073741824 Jul 18 05:52:14 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7aa7a0-b447-4482-ac9c-e2328da5f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f7d66cc-51d7-4593-8a34-753a534060b3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaa5298-fe08-44c7-917c-8947de65555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:14 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Volume volume-8f7d66cc-51d7-4593-8a34-753a534060b3 (8f7d66cc-51d7-4593-8a34-753a534060b3): created successfully Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaa5298-fe08-44c7-917c-8947de65555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:14 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (591997bb-a86d-41e6-801c-bc12858b4f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:15 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5bfd344b-c64d-4a58-8cd7-6ea97fc698ae tempest-CreateVolumesFromImageTest-1589528221 None] Created volume successfully. Jul 18 05:52:15 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 1073741824" returned: 0 in 0.478s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:15 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 Jul 18 05:52:15 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:15 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24" returned: 0 in 0.262s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020098766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c268832-a660-4187-8263-5b234362a6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1069ce9a4a784d6e8a4fa53b03527b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:14Z,use_quota=True,user_id='d9f4594a784a49409892e4ba0b3d1dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Creating volume 3c268832-a660-4187-8263-5b234362a6c3 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:15 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a97a4d-c082-4dee-93d9-d9fad9fdf796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913709a4-0869-423c-85d6-66fbd93d07c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:15 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3 1073741824 Jul 18 05:52:15 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Volume volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 (4a5aabc9-e82f-4b40-82af-848dec5cfe24): created successfully Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913709a4-0869-423c-85d6-66fbd93d07c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (25424bf9-13eb-4165-9be1-2efa8fb41233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:15 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-623d09d2-2820-447b-a81c-13502aaa9c18 tempest-CreateVolumesFromImageTest-1589528221 None] Created volume successfully. Jul 18 05:52:16 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3 1073741824" returned: 0 in 0.494s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:16 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3 Jul 18 05:52:16 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:16 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3" returned: 0 in 0.272s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1057ec-6586-41bc-a7e0-6cc23dc78e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c268832-a660-4187-8263-5b234362a6c3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a871b5-2177-4139-8f1e-da2a71fae6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Volume volume-3c268832-a660-4187-8263-5b234362a6c3 (3c268832-a660-4187-8263-5b234362a6c3): created successfully Jul 18 05:52:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a871b5-2177-4139-8f1e-da2a71fae6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Flow 'volume_create_manager' (4fe3d2e4-c2d8-4dbb-9e20-f9ec6f511c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:16 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-fbe01a8b-96c5-45ba-a370-f626cffdae9d tempest-CreateVolumesFromImageTest-1589528221 None] Created volume successfully. Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-3c268832-a660-4187-8263-5b234362a6c3-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-3c268832-a660-4187-8263-5b234362a6c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-quobyte-3c268832-a660-4187-8263-5b234362a6c3" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-3c268832-a660-4187-8263-5b234362a6c3" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5deff74-fe72-47c6-a51b-78b0347d8592]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:17 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3 Jul 18 05:52:17 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:17 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3" returned: 0 in 0.400s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:17 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3 Jul 18 05:52:17 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:17 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-3c268832-a660-4187-8263-5b234362a6c3" returned: 0 in 0.272s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-3c268832-a660-4187-8263-5b234362a6c3" released by "delete_volume" :: held 0.733s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:17 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Created reservations ['1cf7428b-8cb6-4f20-9be1-6b4aad5e0747', '72313cc8-5a32-4af6-b034-9da88741373d', 'b41c71bf-3e48-41cf-a6b5-5a3664a6d302', '20d6127b-c5d5-48ab-9907-076587ebc560'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:18 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:18 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-4a5aabc9-e82f-4b40-82af-848dec5cfe24-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-4a5aabc9-e82f-4b40-82af-848dec5cfe24-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-quobyte-4a5aabc9-e82f-4b40-82af-848dec5cfe24" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:18 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.316s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-4a5aabc9-e82f-4b40-82af-848dec5cfe24" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Deleted volume successfully. Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ee3006-503f-438f-a0e6-f9638f019cb4]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1583f7ca-5aa8-41fe-90a1-4f48cb031a3e tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-3c268832-a660-4187-8263-5b234362a6c3-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:18 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 Jul 18 05:52:18 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:18 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24" returned: 0 in 0.397s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:18 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24 Jul 18 05:52:18 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:19 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a5aabc9-e82f-4b40-82af-848dec5cfe24" returned: 0 in 0.247s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-4a5aabc9-e82f-4b40-82af-848dec5cfe24" released by "delete_volume" :: held 0.696s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Created reservations ['bb1c2974-b357-4d91-b51b-ab0511360e59', 'db5bc5ae-e0a3-4f3a-9087-aa67742d3288', '09ffbbfe-20a4-46e4-bfc9-5e04334c0ea5', '8e041b21-85c2-4029-852c-734e42965d87'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:19 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:19 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:19 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.249s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Deleted volume successfully. Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b4c82649-efb4-4e43-aed4-fc43434ab259 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-4a5aabc9-e82f-4b40-82af-848dec5cfe24-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-8f7d66cc-51d7-4593-8a34-753a534060b3-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-8f7d66cc-51d7-4593-8a34-753a534060b3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-quobyte-8f7d66cc-51d7-4593-8a34-753a534060b3" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-8f7d66cc-51d7-4593-8a34-753a534060b3" acquired by "delete_volume" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16d313b-932b-4494-979e-59417cc630f5]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:19 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3 Jul 18 05:52:19 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:19 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3" returned: 0 in 0.361s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:19 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3 Jul 18 05:52:19 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:20 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8f7d66cc-51d7-4593-8a34-753a534060b3" returned: 0 in 0.240s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-8f7d66cc-51d7-4593-8a34-753a534060b3" released by "delete_volume" :: held 0.642s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Created reservations ['e495d69d-76b2-4c66-93d7-f906b8d4f6ee', 'cb45f1d2-cbf0-412d-bc52-9471a5effd68', '8d879cb5-1f54-4350-84af-c320a29d2d6b', 'cd57c3ef-1f5a-4e94-92ce-47e072675005'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:20 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:20 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:20 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.241s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Deleted volume successfully. Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-679f1489-fc10-463b-b1ee-d856ebb6374b tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-8f7d66cc-51d7-4593-8a34-753a534060b3-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-e4d8c013-6948-4916-8c75-9d026b6d0cdf-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-e4d8c013-6948-4916-8c75-9d026b6d0cdf-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-quobyte-e4d8c013-6948-4916-8c75-9d026b6d0cdf" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-e4d8c013-6948-4916-8c75-9d026b6d0cdf" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8f6768-295b-4702-ab89-1e25e876c670]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:20 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf Jul 18 05:52:20 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:21 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf" returned: 0 in 0.352s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:21 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf Jul 18 05:52:21 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:21 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e4d8c013-6948-4916-8c75-9d026b6d0cdf" returned: 0 in 0.244s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-e4d8c013-6948-4916-8c75-9d026b6d0cdf" released by "delete_volume" :: held 0.635s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Created reservations ['c1d44c54-92e5-4879-a2f9-bc1545089a84', '4e6fcce6-ce7f-44eb-bec1-aaf9a836cd17', 'c2171df3-1b58-4a71-aa24-47f84e0c610b', 'c1e81df8-a45f-400a-95ca-3bcfcdcd7ddf'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:21 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:21 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:21 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Deleted volume successfully. Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b1dd1f5e-673f-4d96-a28c-a1cddce0c74d tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-e4d8c013-6948-4916-8c75-9d026b6d0cdf-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "cinder-quobyte-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf" acquired by "delete_volume" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2afff5b-1100-4752-bc2e-e03fbff79780]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:22 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf Jul 18 05:52:22 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:22 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf" returned: 0 in 0.352s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:22 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf Jul 18 05:52:22 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:22 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf" returned: 0 in 0.245s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-quobyte-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf" released by "delete_volume" :: held 0.634s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Created reservations ['d502b752-bb71-4990-aec8-5e24382b5f5b', '09f12a42-79f7-479a-9ac5-e9d30e89300c', '85950d98-52fc-4d1f-bcb9-764323f5e419', '4df5ec7a-b621-43db-b7ae-1cd55f9a94f2'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:22 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:22 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:22 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Deleted volume successfully. Jul 18 05:52:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9e5b1a1-48bb-45ac-95d6-d08f572a0c14 tempest-CreateVolumesFromImageTest-1589528221 None] Lock "cinder-f058ae1e-7ca6-4e46-ae72-9a581ccaecdf-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:28 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Flow 'volume_create_manager' (89d23d02-fd66-44ce-98ba-70427e01711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522336cd-d9ec-4155-9556-122b18138a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522336cd-d9ec-4155-9556-122b18138a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287a83b5-f8f1-4744-95f7-e813a7ff532c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d85d8baf134ea98525e7da1dde566b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:29Z,use_quota=True,user_id='30c6e1bcee3b4657a5ca989598430f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bcd108-96b4-468c-8ea6-35b7cfe9f9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bcd108-96b4-468c-8ea6-35b7cfe9f9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa21a70a-c9be-49fe-a01e-eb3b39131caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:28 devstack cinder-volume[87497]: DEBUG cinder.image.glance [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Creating Keystone auth plugin from conf {{(pid=87497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-7c4f23a5-6c48-4c08-8455-1ac8fcd2b660 req-4a28ca4b-56c8-41e0-a4dd-e733b8104715 tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-7c4f23a5-6c48-4c08-8455-1ac8fcd2b660 req-4a28ca4b-56c8-41e0-a4dd-e733b8104715 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-7c4f23a5-6c48-4c08-8455-1ac8fcd2b660 req-4a28ca4b-56c8-41e0-a4dd-e733b8104715 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-7c4f23a5-6c48-4c08-8455-1ac8fcd2b660 req-4a28ca4b-56c8-41e0-a4dd-e733b8104715 tempest-TestServerVolumeAttachmentScenario-758707733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-1d522973-6e0f-4f9d-9845-307518f6685d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fdd2320-1ac0-4845-93bc-a1fac2e1d375', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:52:29 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-7c4f23a5-6c48-4c08-8455-1ac8fcd2b660 req-4a28ca4b-56c8-41e0-a4dd-e733b8104715 tempest-TestServerVolumeAttachmentScenario-758707733 None] attachment_update completed successfully. Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa21a70a-c9be-49fe-a01e-eb3b39131caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '287a83b5-f8f1-4744-95f7-e813a7ff532c', 'volume_name': 'volume-287a83b5-f8f1-4744-95f7-e813a7ff532c', 'volume_size': 1, 'image_id': 'b1876951-9583-4f82-8d36-4355b744ba1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1876951-9583-4f82-8d36-4355b744ba1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2041337211c97b310a03622938de284e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10d85d8baf134ea98525e7da1dde566b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a571733f836a9dbba586794bb5e24f19efcc9710b87d2acca1ab2402b07c697e457bc7fa56aa2e5283ad8ce24cc93ab826cc86b752fdc1cb748ce81d71ab4c89', 'id': 'b1876951-9583-4f82-8d36-4355b744ba1a', 'created_at': datetime.datetime(2026, 7, 18, 3, 52, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 52, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1876951-9583-4f82-8d36-4355b744ba1a/file', 'properties': {}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ef28c8-e950-4eaa-bbe9-8745e9b56d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ef28c8-e950-4eaa-bbe9-8745e9b56d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d7a5e4-de93-4cac-8f27-889a86d4596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:29 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Volume 287a83b5-f8f1-4744-95f7-e813a7ff532c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-287a83b5-f8f1-4744-95f7-e813a7ff532c', 'volume_size': 1, 'image_id': 'b1876951-9583-4f82-8d36-4355b744ba1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1876951-9583-4f82-8d36-4355b744ba1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2041337211c97b310a03622938de284e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10d85d8baf134ea98525e7da1dde566b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a571733f836a9dbba586794bb5e24f19efcc9710b87d2acca1ab2402b07c697e457bc7fa56aa2e5283ad8ce24cc93ab826cc86b752fdc1cb748ce81d71ab4c89', 'id': 'b1876951-9583-4f82-8d36-4355b744ba1a', 'created_at': datetime.datetime(2026, 7, 18, 3, 52, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 52, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1876951-9583-4f82-8d36-4355b744ba1a/file', 'properties': {}}, 'image_service': } Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Trying to clone 287a83b5-f8f1-4744-95f7-e813a7ff532c from image b1876951-9583-4f82-8d36-4355b744ba1a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1876951-9583-4f82-8d36-4355b744ba1a', 'metadata': {}}]). {{(pid=87497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 05:52:29 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Image download 0.00 MB at 0.00 MB/s Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc1cd4e-e2bb-4fcb-9460-73dd4c9a05f7]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:29 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-34c3753e-f563-41d1-a1ad-9d15842b9386 req-05494e9a-3945-4390-8bef-0f7ad023e3c3 tempest-TestMinimumBasicScenario-1542347796 None] Terminate volume connection completed successfully. Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-34c3753e-f563-41d1-a1ad-9d15842b9386 req-05494e9a-3945-4390-8bef-0f7ad023e3c3 tempest-TestMinimumBasicScenario-1542347796 None] Deleting attachment 6c34a399-5d2b-439f-8d74-b4601cd019cf. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:52:29 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD Jul 18 05:52:29 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:29 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:30 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD Jul 18 05:52:30 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:30 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Temporary image b1876951-9583-4f82-8d36-4355b744ba1a is fetched for user 30c6e1bcee3b4657a5ca989598430f0c. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[164602d8-a51f-47c2-8cb1-0278298c7ac5]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Acquiring lock "cinder-42a0b236-1185-471b-97a6-dffd0975ecc4-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Lock "cinder-42a0b236-1185-471b-97a6-dffd0975ecc4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Acquiring lock "cinder-quobyte-42a0b236-1185-471b-97a6-dffd0975ecc4" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:30 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD Jul 18 05:52:30 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Lock "cinder-quobyte-42a0b236-1185-471b-97a6-dffd0975ecc4" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1350cb1f-13b7-41e1-99ee-f1814898ebcf]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:30 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4 Jul 18 05:52:30 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:30 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:30 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD Jul 18 05:52:30 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:30 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4" returned: 0 in 0.377s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:30 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4 Jul 18 05:52:30 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:31 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287a83b5-f8f1-4744-95f7-e813a7ff532c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d85d8baf134ea98525e7da1dde566b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:29Z,use_quota=True,user_id='30c6e1bcee3b4657a5ca989598430f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Creating volume 287a83b5-f8f1-4744-95f7-e813a7ff532c {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:31 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:31 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c 1073741824 Jul 18 05:52:31 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:31 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-42a0b236-1185-471b-97a6-dffd0975ecc4" returned: 0 in 0.276s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Lock "cinder-quobyte-42a0b236-1185-471b-97a6-dffd0975ecc4" released by "delete_volume" :: held 0.704s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Created reservations ['e06d1796-3ef3-4a8a-9844-a68613a12a99', '0f1314b4-c8ff-452a-a7d5-062144af60b4', 'f7fd48f5-ce96-494e-a29b-8a4dff984951', '7cb2a87c-bffd-4a78-a224-223a60a2c7cb'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:31 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:31 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:31 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c 1073741824" returned: 0 in 0.475s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:31 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:31 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c Jul 18 05:52:31 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Deleted volume successfully. Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b01dc5d2-0a47-41c4-93f8-258f0821404c tempest-TestMinimumBasicScenario-1542347796 None] Lock "cinder-42a0b236-1185-471b-97a6-dffd0975ecc4-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:31 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c" returned: 0 in 0.298s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Attempting download of b1876951-9583-4f82-8d36-4355b744ba1a ((None, [{'url': 'file:///opt/stack/data/glance/images/b1876951-9583-4f82-8d36-4355b744ba1a', 'metadata': {}}])) to volume 287a83b5-f8f1-4744-95f7-e813a7ff532c. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4738883-4ac8-4ae8-b0da-a5877a527f8e]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1876951-9583-4f82-8d36-4355b744ba1a_ef0zguai {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:32 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1876951-9583-4f82-8d36-4355b744ba1a_ef0zguai Jul 18 05:52:32 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:32 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1876951-9583-4f82-8d36-4355b744ba1a_ef0zguai" returned: 0 in 0.570s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1876951-9583-4f82-8d36-4355b744ba1a_ef0zguai {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:32 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1876951-9583-4f82-8d36-4355b744ba1a_ef0zguai Jul 18 05:52:32 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:32 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1876951-9583-4f82-8d36-4355b744ba1a_ef0zguai" returned: 1 in 0.439s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1876951-9583-4f82-8d36-4355b744ba1a_ef0zguai' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:52:32 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aa6931-0c41-4dea-b309-8a496aa207bb]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:33 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD Jul 18 05:52:33 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:33 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:33 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD Jul 18 05:52:33 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:33 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:52:33 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] b1876951-9583-4f82-8d36-4355b744ba1a was raw, converting to qcow2 {{(pid=87497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 05:52:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:33 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c Jul 18 05:52:33 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-dd92f3c2-fec2-4f9f-82ab-119c83943650 req-93e12bbf-a282-4ece-9fb2-22486e3e80c1 tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-dd92f3c2-fec2-4f9f-82ab-119c83943650 req-93e12bbf-a282-4ece-9fb2-22486e3e80c1 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-dd92f3c2-fec2-4f9f-82ab-119c83943650 req-93e12bbf-a282-4ece-9fb2-22486e3e80c1 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-dd92f3c2-fec2-4f9f-82ab-119c83943650 req-93e12bbf-a282-4ece-9fb2-22486e3e80c1 tempest-TestServerVolumeAttachmentScenario-758707733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-e296df26-9b24-4e31-9319-133ee3cd84bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02e98051-5586-492d-a48b-89b7bf88f1f8', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:52:34 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c" returned: 0 in 0.561s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1876951-9583-4f82-8d36-4355b744ba1a__vlf47tjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:52:34 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Converted 0.00 MB image at 0.00 MB/s Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:34 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c 1G Jul 18 05:52:34 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:34 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-dd92f3c2-fec2-4f9f-82ab-119c83943650 req-93e12bbf-a282-4ece-9fb2-22486e3e80c1 tempest-TestServerVolumeAttachmentScenario-758707733 None] attachment_update completed successfully. Jul 18 05:52:34 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c 1G" returned: 0 in 0.389s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Downloaded image b1876951-9583-4f82-8d36-4355b744ba1a ((None, [{'url': 'file:///opt/stack/data/glance/images/b1876951-9583-4f82-8d36-4355b744ba1a', 'metadata': {}}])) to volume 287a83b5-f8f1-4744-95f7-e813a7ff532c successfully. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Temporary image b1876951-9583-4f82-8d36-4355b744ba1a for user 30c6e1bcee3b4657a5ca989598430f0c is deleted. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Marking volume 287a83b5-f8f1-4744-95f7-e813a7ff532c as bootable. {{(pid=87497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Copying metadata from image b1876951-9583-4f82-8d36-4355b744ba1a to 287a83b5-f8f1-4744-95f7-e813a7ff532c. {{(pid=87497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Creating volume glance metadata for volume 287a83b5-f8f1-4744-95f7-e813a7ff532c backed by image b1876951-9583-4f82-8d36-4355b744ba1a with: {'image_id': 'b1876951-9583-4f82-8d36-4355b744ba1a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2041337211c97b310a03622938de284e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d7a5e4-de93-4cac-8f27-889a86d4596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287a83b5-f8f1-4744-95f7-e813a7ff532c', 'volume_size': 1, 'image_id': 'b1876951-9583-4f82-8d36-4355b744ba1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1876951-9583-4f82-8d36-4355b744ba1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2041337211c97b310a03622938de284e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10d85d8baf134ea98525e7da1dde566b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a571733f836a9dbba586794bb5e24f19efcc9710b87d2acca1ab2402b07c697e457bc7fa56aa2e5283ad8ce24cc93ab826cc86b752fdc1cb748ce81d71ab4c89', 'id': 'b1876951-9583-4f82-8d36-4355b744ba1a', 'created_at': datetime.datetime(2026, 7, 18, 3, 52, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 52, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1876951-9583-4f82-8d36-4355b744ba1a/file', 'properties': {}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded941ba-5466-420a-b87f-d9b73829ce62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:34 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Volume volume-287a83b5-f8f1-4744-95f7-e813a7ff532c (287a83b5-f8f1-4744-95f7-e813a7ff532c): created successfully Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded941ba-5466-420a-b87f-d9b73829ce62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Flow 'volume_create_manager' (89d23d02-fd66-44ce-98ba-70427e01711c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:34 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-80cec98c-e281-42c9-a233-ecb582c5a1bc tempest-VolumeImageDependencyTests-1112922443 None] Created volume successfully. Jul 18 05:52:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Acquiring lock "cinder-287a83b5-f8f1-4744-95f7-e813a7ff532c-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Lock "cinder-287a83b5-f8f1-4744-95f7-e813a7ff532c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Acquiring lock "cinder-quobyte-287a83b5-f8f1-4744-95f7-e813a7ff532c" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Lock "cinder-quobyte-287a83b5-f8f1-4744-95f7-e813a7ff532c" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e0cfb9-d285-4e95-9bf3-3600bf82eafd]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:35 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c Jul 18 05:52:35 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:35 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c" returned: 0 in 0.383s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:35 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c Jul 18 05:52:35 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:36 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-287a83b5-f8f1-4744-95f7-e813a7ff532c" returned: 0 in 0.246s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Lock "cinder-quobyte-287a83b5-f8f1-4744-95f7-e813a7ff532c" released by "delete_volume" :: held 0.674s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Created reservations ['8e65ba82-ed01-4fe0-8cbb-8f5a94d87e94', 'bd3012be-9fc3-45fe-b5bd-09c7c65ed1f0', '023a8182-80ee-4be5-b546-60d15f62a121', 'e7d7c707-32c4-4915-962c-4d1990e336a5'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:36 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:36 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:36 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.291s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:36 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Deleted volume successfully. Jul 18 05:52:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b4ee492-16ed-4f64-95cb-b8310c2c3127 tempest-VolumeImageDependencyTests-1112922443 None] Lock "cinder-287a83b5-f8f1-4744-95f7-e813a7ff532c-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-0333f349-035c-4814-b5bb-e93499dbe59e req-9f9c4ae0-ec2d-4b2f-88bd-6912b37930cb tempest-TestServerVolumeAttachmentScenario-758707733 None] Terminate volume connection completed successfully. Jul 18 05:52:37 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-0333f349-035c-4814-b5bb-e93499dbe59e req-9f9c4ae0-ec2d-4b2f-88bd-6912b37930cb tempest-TestServerVolumeAttachmentScenario-758707733 None] Deleting attachment 02e98051-5586-492d-a48b-89b7bf88f1f8. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:52:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-3e83cba0-16ec-4b03-b836-8926a7587a8b req-1e4cfa20-9b27-4787-b673-bdb1861c2e10 tempest-TestServerVolumeAttachmentScenario-758707733 None] Terminate volume connection completed successfully. Jul 18 05:52:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-3e83cba0-16ec-4b03-b836-8926a7587a8b req-1e4cfa20-9b27-4787-b673-bdb1861c2e10 tempest-TestServerVolumeAttachmentScenario-758707733 None] Deleting attachment 2fdd2320-1ac0-4845-93bc-a1fac2e1d375. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Flow 'volume_create_manager' (1a0884e9-b814-4344-8c79-71c3cf9f1fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bcd740-21a3-4250-9adb-af261220638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bcd740-21a3-4250-9adb-af261220638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128039326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83968398-99eb-45fb-b706-fddf7b046205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3214df9ec6a04fa99e34bff11288b1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:41Z,use_quota=True,user_id='47ddd91b94104f279e8344577c562616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec778a7-aa14-455b-a809-69dbfff27962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec778a7-aa14-455b-a809-69dbfff27962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28906b2c-3c49-4135-a2b9-92618c1415eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28906b2c-3c49-4135-a2b9-92618c1415eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83968398-99eb-45fb-b706-fddf7b046205', 'volume_name': 'volume-83968398-99eb-45fb-b706-fddf7b046205', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899e0e0c-cef1-4763-b340-62339ade14c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899e0e0c-cef1-4763-b340-62339ade14c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d71084-ffc0-46c8-a843-44d89d539474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:41 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Volume 83968398-99eb-45fb-b706-fddf7b046205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83968398-99eb-45fb-b706-fddf7b046205', 'volume_size': 1} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128039326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83968398-99eb-45fb-b706-fddf7b046205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3214df9ec6a04fa99e34bff11288b1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:41Z,use_quota=True,user_id='47ddd91b94104f279e8344577c562616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Creating volume 83968398-99eb-45fb-b706-fddf7b046205 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:41 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:41 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205 1073741824 Jul 18 05:52:41 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:41 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205 1073741824" returned: 0 in 0.544s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:41 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205 Jul 18 05:52:41 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:42 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205" returned: 0 in 0.285s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d71084-ffc0-46c8-a843-44d89d539474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83968398-99eb-45fb-b706-fddf7b046205', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3b489c-ca79-4658-8a50-fafaa7284663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:42 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Volume volume-83968398-99eb-45fb-b706-fddf7b046205 (83968398-99eb-45fb-b706-fddf7b046205): created successfully Jul 18 05:52:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3b489c-ca79-4658-8a50-fafaa7284663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Flow 'volume_create_manager' (1a0884e9-b814-4344-8c79-71c3cf9f1fa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-250e367a-3015-4790-b92a-7098eb3135a7 tempest-ProjectReaderTests-317462062 None] Created volume successfully. Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Acquiring lock "cinder-83968398-99eb-45fb-b706-fddf7b046205-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Lock "cinder-83968398-99eb-45fb-b706-fddf7b046205-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Acquiring lock "cinder-quobyte-83968398-99eb-45fb-b706-fddf7b046205" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Lock "cinder-quobyte-83968398-99eb-45fb-b706-fddf7b046205" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced1ef41-ff30-4ec5-9005-975144fd7e91]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "cinder-e296df26-9b24-4e31-9319-133ee3cd84bf-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:43 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205 Jul 18 05:52:43 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "cinder-e296df26-9b24-4e31-9319-133ee3cd84bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "cinder-quobyte-e296df26-9b24-4e31-9319-133ee3cd84bf" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "cinder-quobyte-e296df26-9b24-4e31-9319-133ee3cd84bf" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4d8816-8553-4696-a239-52d90022b4f8]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:43 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf Jul 18 05:52:43 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:43 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205" returned: 0 in 0.399s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:43 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205 Jul 18 05:52:43 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:44 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf" returned: 0 in 0.484s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:44 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-83968398-99eb-45fb-b706-fddf7b046205" returned: 0 in 0.357s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:44 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Lock "cinder-quobyte-83968398-99eb-45fb-b706-fddf7b046205" released by "delete_volume" :: held 0.805s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:44 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Created reservations ['01781e9d-0f7b-4bb9-bbc9-da9233a3c348', '3ab06d08-b97a-4796-b0a0-5eeb20277e89', 'cbf13158-ce06-4755-b6fc-b6600d287acf', '13b4484b-79f6-4c42-8047-bad7090522d2'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:44 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:44 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:44 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e296df26-9b24-4e31-9319-133ee3cd84bf" returned: 0 in 0.318s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "cinder-quobyte-e296df26-9b24-4e31-9319-133ee3cd84bf" released by "delete_volume" :: held 0.866s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Created reservations ['523a7cbd-ca8e-47c8-b19f-a049496793ac', 'a27025fe-5815-454f-a0a3-452d664810a6', '6c2fe10c-26ef-42f5-bd7c-b89139095b42', '28cd4bdb-d3b5-4d19-98e8-1ee642193081'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:44 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.313s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:44 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Deleted volume successfully. Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-32aea856-3d3b-467c-94e4-9998159da759 tempest-ProjectReaderTests-317462062 None] Lock "cinder-83968398-99eb-45fb-b706-fddf7b046205-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:44 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:44 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "cinder-1d522973-6e0f-4f9d-9845-307518f6685d-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "cinder-1d522973-6e0f-4f9d-9845-307518f6685d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "cinder-quobyte-1d522973-6e0f-4f9d-9845-307518f6685d" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "cinder-quobyte-1d522973-6e0f-4f9d-9845-307518f6685d" acquired by "delete_volume" :: waited 0.035s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91ae48c-086a-46a7-bd19-b46e199448fd]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:45 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:45 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d Jul 18 05:52:45 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.454s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:45 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Deleted volume successfully. Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Flow 'volume_create_manager' (d1f9d9fb-7cd4-496f-bf3a-fae6bbead85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3867ae1-acd8-433e-900e-df63ac2bcf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3867ae1-acd8-433e-900e-df63ac2bcf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004890817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf651a45-73c7-4b08-906b-797295bd2bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3214df9ec6a04fa99e34bff11288b1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:45Z,use_quota=True,user_id='47ddd91b94104f279e8344577c562616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd019e68-8e51-4a8b-8edc-d8a5b45b7263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd019e68-8e51-4a8b-8edc-d8a5b45b7263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9873b186-df27-437f-bcaa-2ec063f84ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9873b186-df27-437f-bcaa-2ec063f84ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf651a45-73c7-4b08-906b-797295bd2bef', 'volume_name': 'volume-cf651a45-73c7-4b08-906b-797295bd2bef', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a15c74-7beb-483d-b73c-5857843096c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a15c74-7beb-483d-b73c-5857843096c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0b9002-34a9-4139-9f38-de5d99aec590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:45 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Volume cf651a45-73c7-4b08-906b-797295bd2bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf651a45-73c7-4b08-906b-797295bd2bef', 'volume_size': 1} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004890817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf651a45-73c7-4b08-906b-797295bd2bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3214df9ec6a04fa99e34bff11288b1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:45Z,use_quota=True,user_id='47ddd91b94104f279e8344577c562616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Creating volume cf651a45-73c7-4b08-906b-797295bd2bef {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:45 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-05ad0560-62f0-4520-bc28-0c40bc63f1b6 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "cinder-e296df26-9b24-4e31-9319-133ee3cd84bf-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:45 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef 1073741824 Jul 18 05:52:45 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:45 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d" returned: 0 in 0.500s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:45 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d Jul 18 05:52:45 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:45 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1d522973-6e0f-4f9d-9845-307518f6685d" returned: 0 in 0.273s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "cinder-quobyte-1d522973-6e0f-4f9d-9845-307518f6685d" released by "delete_volume" :: held 0.842s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:45 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef 1073741824" returned: 0 in 0.509s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Created reservations ['5fc6a118-a3e4-42ff-ba02-dda4f489b71f', 'ad5a05ac-2674-4af1-871d-b2f28498c7c4', '0c07ecf5-4edc-4df8-935d-045090a4a19a', 'ec71b4bc-77b5-4480-bf7d-37971ca18a0f'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:45 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef Jul 18 05:52:45 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:46 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:46 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:46 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef" returned: 0 in 0.355s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0b9002-34a9-4139-9f38-de5d99aec590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf651a45-73c7-4b08-906b-797295bd2bef', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85453199-b2d4-4d15-9599-49d955a49bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:46 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Volume volume-cf651a45-73c7-4b08-906b-797295bd2bef (cf651a45-73c7-4b08-906b-797295bd2bef): created successfully Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85453199-b2d4-4d15-9599-49d955a49bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Flow 'volume_create_manager' (d1f9d9fb-7cd4-496f-bf3a-fae6bbead85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-88f455ed-64aa-4d08-8cd1-f82ad1c2cc74 tempest-ProjectReaderTests-317462062 None] Created volume successfully. Jul 18 05:52:46 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.359s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Deleted volume successfully. Jul 18 05:52:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b72237f0-67fa-4166-b8d1-7b0397e2e081 tempest-TestServerVolumeAttachmentScenario-758707733 None] Lock "cinder-1d522973-6e0f-4f9d-9845-307518f6685d-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Acquiring lock "cinder-cf651a45-73c7-4b08-906b-797295bd2bef-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Lock "cinder-cf651a45-73c7-4b08-906b-797295bd2bef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Acquiring lock "cinder-quobyte-cf651a45-73c7-4b08-906b-797295bd2bef" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:52:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Lock "cinder-quobyte-cf651a45-73c7-4b08-906b-797295bd2bef" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:52:47 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ea5568-40a3-493e-999b-d34ee73fbbe2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:47 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef Jul 18 05:52:47 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:47 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef" returned: 0 in 0.456s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:47 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef Jul 18 05:52:47 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:48 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cf651a45-73c7-4b08-906b-797295bd2bef" returned: 0 in 0.265s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Lock "cinder-quobyte-cf651a45-73c7-4b08-906b-797295bd2bef" released by "delete_volume" :: held 0.787s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Created reservations ['cd051b30-65b6-424d-ad0d-f875f4e16913', '8f20339e-f629-4650-a13d-dfac5b7c64da', '336a9c28-3367-43bd-889b-6958cf5916be', 'f80b96b5-584f-4b9f-b747-c502b8500e17'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:48 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:52:48 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:48 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.278s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:52:48 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Deleted volume successfully. Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07381003-de2a-4bed-8d04-cfec45ffd4ad tempest-ProjectReaderTests-317462062 None] Lock "cinder-cf651a45-73c7-4b08-906b-797295bd2bef-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:52:48 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (65ea9aef-64f6-4cb1-a220-7da2c8d3e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f52cffd-3816-45fa-8780-b0006b6e750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f52cffd-3816-45fa-8780-b0006b6e750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261706829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14931e37-c008-43a5-b7b7-2c78eeccc7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:49Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d10b9ce-9233-4c0b-a5f4-2d5b2622be2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d10b9ce-9233-4c0b-a5f4-2d5b2622be2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed79efe-483e-437e-9fde-a2e188869cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed79efe-483e-437e-9fde-a2e188869cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14931e37-c008-43a5-b7b7-2c78eeccc7ef', 'volume_name': 'volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730fd9bc-24ab-4683-be2d-56f1b363de10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730fd9bc-24ab-4683-be2d-56f1b363de10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c7f5b5-0c60-4c7c-b838-9ef5490977f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:49 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume 14931e37-c008-43a5-b7b7-2c78eeccc7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef', 'volume_size': 1} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261706829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14931e37-c008-43a5-b7b7-2c78eeccc7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:49Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Creating volume 14931e37-c008-43a5-b7b7-2c78eeccc7ef {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:49 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:49 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef 1073741824 Jul 18 05:52:49 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:49 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef 1073741824" returned: 0 in 0.613s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:49 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef Jul 18 05:52:49 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:50 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef" returned: 0 in 0.334s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c7f5b5-0c60-4c7c-b838-9ef5490977f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e7f2c5-e391-4cd7-9887-7383a95d4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:50 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef (14931e37-c008-43a5-b7b7-2c78eeccc7ef): created successfully Jul 18 05:52:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e7f2c5-e391-4cd7-9887-7383a95d4c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (65ea9aef-64f6-4cb1-a220-7da2c8d3e74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:50 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-153f11df-caba-4369-ab3f-19f208c4966f tempest-CreateVolumesFromSnapshotTest-358747059 None] Created volume successfully. Jul 18 05:52:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Creating offline snapshot 7c354d32-c4f5-4745-b591-5825f8b9d018 of volume 14931e37-c008-43a5-b7b7-2c78eeccc7ef {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:52:51 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cefa53-415c-46f0-8c13-098a01ed64ad]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:52:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:51 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef Jul 18 05:52:51 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:51 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef" returned: 0 in 0.408s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:51 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 1G Jul 18 05:52:51 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:52 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 1G" returned: 0 in 0.475s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:52 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 Jul 18 05:52:52 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:52 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018" returned: 0 in 0.334s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:52 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 is being set with open permissions: ugo+rw Jul 18 05:52:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:52 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 Jul 18 05:52:52 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:52 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018" returned: 0 in 0.276s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:53 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.info Jul 18 05:52:53 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:53 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.info" returned: 0 in 0.325s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:53 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.info is being set with open permissions: ugo+rw Jul 18 05:52:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:53 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.info Jul 18 05:52:53 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:53 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.info" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-55e86459-73c2-4366-800d-41d01f3598e7 tempest-CreateVolumesFromSnapshotTest-358747059 None] Create snapshot completed successfully Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (f3cb61fd-fef2-4240-99b3-fe5c25dfa904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1c0ae8-8258-4486-b835-ce8c5d8926be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1c0ae8-8258-4486-b835-ce8c5d8926be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1899413280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e083f8c1-5ac6-4218-8630-0a5d0ade0175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:55Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7117c6-7f04-4166-b963-e8f0749a8d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7117c6-7f04-4166-b963-e8f0749a8d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87da98ad-bbee-4cf5-b777-9a695344d703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87da98ad-bbee-4cf5-b777-9a695344d703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e083f8c1-5ac6-4218-8630-0a5d0ade0175', 'volume_name': 'volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef16b5b-6470-4601-a0da-a82ccf5c22b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef16b5b-6470-4601-a0da-a82ccf5c22b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d0e85d-e129-4aaa-bf97-6deaf34bb533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume e083f8c1-5ac6-4218-8630-0a5d0ade0175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175', 'volume_size': 1} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1899413280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e083f8c1-5ac6-4218-8630-0a5d0ade0175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:55Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Creating volume e083f8c1-5ac6-4218-8630-0a5d0ade0175 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:55 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:55 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 1073741824 Jul 18 05:52:55 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (e422e45d-b688-4e58-b7a6-f997f499a687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0867f6aa-66ad-45a5-85dd-883f20f93d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0867f6aa-66ad-45a5-85dd-883f20f93d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521829498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff428afc-e1d6-4d69-a341-f908f9f1a7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:56Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df0d9e2-8c82-40b9-bda1-c1d5a837e2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df0d9e2-8c82-40b9-bda1-c1d5a837e2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e8e376-3d49-4049-b70f-7f2d382a2279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e8e376-3d49-4049-b70f-7f2d382a2279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff428afc-e1d6-4d69-a341-f908f9f1a7d8', 'volume_name': 'volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3deca104-61fb-4aab-811d-b7f6e2a2cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3deca104-61fb-4aab-811d-b7f6e2a2cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e55a68d-dd18-4307-b0d2-03ca6c9d4fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:55 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume ff428afc-e1d6-4d69-a341-f908f9f1a7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8', 'volume_size': 1} Jul 18 05:52:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:56 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 1073741824" returned: 0 in 0.731s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:56 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 Jul 18 05:52:56 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (2c9a513e-4a23-447b-95ce-70dc075696f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb386f76-58a8-4256-a843-b3d4b9be6f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb386f76-58a8-4256-a843-b3d4b9be6f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-652398411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0675fe8-22cc-496e-a1b1-8becc0ce3892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:56Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d17569c-382b-418c-8416-e922df760f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d17569c-382b-418c-8416-e922df760f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa81953a-ba55-4747-9293-acbcacb0fbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa81953a-ba55-4747-9293-acbcacb0fbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0675fe8-22cc-496e-a1b1-8becc0ce3892', 'volume_name': 'volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef68a45c-49e8-4630-95b8-93735d367424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef68a45c-49e8-4630-95b8-93735d367424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a493746-e266-429f-9630-3162c7d70f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume c0675fe8-22cc-496e-a1b1-8becc0ce3892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892', 'volume_size': 1} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:56 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175" returned: 0 in 0.525s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.882s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521829498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff428afc-e1d6-4d69-a341-f908f9f1a7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:56Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Creating volume ff428afc-e1d6-4d69-a341-f908f9f1a7d8 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:56 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d0e85d-e129-4aaa-bf97-6deaf34bb533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fa8af6-4ee7-4b55-ab2f-fc88dd2fc7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 1073741824 Jul 18 05:52:56 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:56 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 (e083f8c1-5ac6-4218-8630-0a5d0ade0175): created successfully Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fa8af6-4ee7-4b55-ab2f-fc88dd2fc7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (f3cb61fd-fef2-4240-99b3-fe5c25dfa904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (2effe080-fc79-49c9-8b68-e12f14c51889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52268faf-7f8a-4712-84ee-888994ccb091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c92bce1a-671c-406a-8308-a9a962a15998 tempest-CreateVolumesFromSnapshotTest-358747059 None] Created volume successfully. Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52268faf-7f8a-4712-84ee-888994ccb091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972057195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23815d42-0770-448a-9b6e-d277aa48522e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:57Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f0191a-cd0f-4b29-8a87-8772f3cf03e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f0191a-cd0f-4b29-8a87-8772f3cf03e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be19d13-b5b6-409f-bc81-659e71fc06f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be19d13-b5b6-409f-bc81-659e71fc06f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23815d42-0770-448a-9b6e-d277aa48522e', 'volume_name': 'volume-23815d42-0770-448a-9b6e-d277aa48522e', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0400d672-99c8-47c6-bf94-03761a53dca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0400d672-99c8-47c6-bf94-03761a53dca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57253c95-5b38-4194-83f0-296bea1bd459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:56 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume 23815d42-0770-448a-9b6e-d277aa48522e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23815d42-0770-448a-9b6e-d277aa48522e', 'volume_size': 1} Jul 18 05:52:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (33fa1f3c-a34e-41a2-94b1-93b40c91e39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dee0d01-4c1b-4050-b0a0-f66020577de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dee0d01-4c1b-4050-b0a0-f66020577de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1209152286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345a171a-1921-4e09-a34c-6c6a46cfb7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:57Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1139d8-b889-4fda-8082-4fb66967b8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1139d8-b889-4fda-8082-4fb66967b8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a808e99-f7f7-4197-ad78-de97d0a81348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a808e99-f7f7-4197-ad78-de97d0a81348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '345a171a-1921-4e09-a34c-6c6a46cfb7d8', 'volume_name': 'volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:57 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107b2de6-7af4-4372-a105-43f14bd6fd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107b2de6-7af4-4372-a105-43f14bd6fd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399d96ca-5655-4c2b-a873-98ac75f8188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:57 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume 345a171a-1921-4e09-a34c-6c6a46cfb7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8', 'volume_size': 1} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 1073741824" returned: 0 in 0.794s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:57 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 Jul 18 05:52:57 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:57 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8" returned: 0 in 0.281s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-652398411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0675fe8-22cc-496e-a1b1-8becc0ce3892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:56Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Creating volume c0675fe8-22cc-496e-a1b1-8becc0ce3892 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:57 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e55a68d-dd18-4307-b0d2-03ca6c9d4fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:57 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 1073741824 Jul 18 05:52:57 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f86f41-0a21-482e-9944-26d649e375ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:57 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 (ff428afc-e1d6-4d69-a341-f908f9f1a7d8): created successfully Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f86f41-0a21-482e-9944-26d649e375ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (e422e45d-b688-4e58-b7a6-f997f499a687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a21e6fb5-c776-4bc5-bb78-b768b304d8f9 tempest-CreateVolumesFromSnapshotTest-358747059 None] Created volume successfully. Jul 18 05:52:58 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 1073741824" returned: 0 in 0.449s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:58 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 Jul 18 05:52:58 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:58 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892" returned: 0 in 0.299s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1972057195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23815d42-0770-448a-9b6e-d277aa48522e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:57Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Creating volume 23815d42-0770-448a-9b6e-d277aa48522e {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:58 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a493746-e266-429f-9630-3162c7d70f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:58 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e 1073741824 Jul 18 05:52:58 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac55d03-2620-45f2-8f82-f0407d856f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:58 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 (c0675fe8-22cc-496e-a1b1-8becc0ce3892): created successfully Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac55d03-2620-45f2-8f82-f0407d856f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (2c9a513e-4a23-447b-95ce-70dc075696f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:58 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6834ba80-5624-436b-94b8-6a7152dba0d2 tempest-CreateVolumesFromSnapshotTest-358747059 None] Created volume successfully. Jul 18 05:52:59 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e 1073741824" returned: 0 in 0.448s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:59 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e Jul 18 05:52:59 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:59 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e" returned: 0 in 0.258s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1209152286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345a171a-1921-4e09-a34c-6c6a46cfb7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f399b269ef604ae2ab818fc4385e871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:52:57Z,use_quota=True,user_id='19ea4a0223f74f70b7d2ea50979825b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Creating volume 345a171a-1921-4e09-a34c-6c6a46cfb7d8 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:52:59 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57253c95-5b38-4194-83f0-296bea1bd459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23815d42-0770-448a-9b6e-d277aa48522e', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:59 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 1073741824 Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958e6347-62ae-4d3d-b427-f033d169e092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:52:59 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:52:59 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume volume-23815d42-0770-448a-9b6e-d277aa48522e (23815d42-0770-448a-9b6e-d277aa48522e): created successfully Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958e6347-62ae-4d3d-b427-f033d169e092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (2effe080-fc79-49c9-8b68-e12f14c51889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:52:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-07608710-f23c-4395-9ef6-32710e8be433 tempest-CreateVolumesFromSnapshotTest-358747059 None] Created volume successfully. Jul 18 05:52:59 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 1073741824" returned: 0 in 0.504s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:52:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:52:59 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 Jul 18 05:52:59 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:00 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8" returned: 0 in 0.281s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399d96ca-5655-4c2b-a873-98ac75f8188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d2a38c-1ba6-48a3-9b8c-c131c5ab0b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:53:00 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Volume volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 (345a171a-1921-4e09-a34c-6c6a46cfb7d8): created successfully Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d2a38c-1ba6-48a3-9b8c-c131c5ab0b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Flow 'volume_create_manager' (33fa1f3c-a34e-41a2-94b1-93b40c91e39a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:53:00 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-661f6ba1-1a7c-4c02-a380-0a4ec81d77cd tempest-CreateVolumesFromSnapshotTest-358747059 None] Created volume successfully. Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-345a171a-1921-4e09-a34c-6c6a46cfb7d8-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-345a171a-1921-4e09-a34c-6c6a46cfb7d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-quobyte-345a171a-1921-4e09-a34c-6c6a46cfb7d8" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-345a171a-1921-4e09-a34c-6c6a46cfb7d8" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f78e5fa-42fe-4515-ab22-4175994f75f8]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:53:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:01 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 Jul 18 05:53:01 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:01 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8" returned: 0 in 0.418s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:01 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8 Jul 18 05:53:01 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:01 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-345a171a-1921-4e09-a34c-6c6a46cfb7d8" returned: 0 in 0.257s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-345a171a-1921-4e09-a34c-6c6a46cfb7d8" released by "delete_volume" :: held 0.726s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Created reservations ['b287bd6a-2b4e-4646-93ce-8510cc5909be', '96fd792a-5162-4e22-9469-c67d8a7bb998', 'feb1eae5-4e35-4967-a4d5-22433eddb5db', 'a6c6abe8-3279-4741-bf93-28961474b6f0'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:01 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:53:01 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-23815d42-0770-448a-9b6e-d277aa48522e-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:02 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.276s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:53:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Deleted volume successfully. Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-23815d42-0770-448a-9b6e-d277aa48522e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-36fed5ea-b18a-4c3e-91fe-a350529b836f tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-345a171a-1921-4e09-a34c-6c6a46cfb7d8-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-quobyte-23815d42-0770-448a-9b6e-d277aa48522e" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-23815d42-0770-448a-9b6e-d277aa48522e" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[460e2122-ec32-496b-95ed-483f66659e4a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:02 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e Jul 18 05:53:02 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:02 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e" returned: 0 in 0.451s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:02 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e Jul 18 05:53:02 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:02 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-23815d42-0770-448a-9b6e-d277aa48522e" returned: 0 in 0.268s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-23815d42-0770-448a-9b6e-d277aa48522e" released by "delete_volume" :: held 0.768s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:02 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Created reservations ['7ccc8173-1ae2-4be3-85b3-5dddc84015b1', '505e297e-7462-4b90-8736-1fde4ef1850d', '528f574c-290e-4631-b96c-5f3883e7349b', '7c5c678a-a603-48ba-89bc-d41d054556bd'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:03 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:53:03 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-c0675fe8-22cc-496e-a1b1-8becc0ce3892-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-c0675fe8-22cc-496e-a1b1-8becc0ce3892-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-quobyte-c0675fe8-22cc-496e-a1b1-8becc0ce3892" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-c0675fe8-22cc-496e-a1b1-8becc0ce3892" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:03 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.313s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92311db-c77d-49b4-882b-6d0fa6c3b0ec]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:03 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Deleted volume successfully. Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e84fa431-5b1d-4d33-817c-f508dd756386 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-23815d42-0770-448a-9b6e-d277aa48522e-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:03 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 Jul 18 05:53:03 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:03 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892" returned: 0 in 0.431s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:03 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892 Jul 18 05:53:03 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:04 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c0675fe8-22cc-496e-a1b1-8becc0ce3892" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-c0675fe8-22cc-496e-a1b1-8becc0ce3892" released by "delete_volume" :: held 0.780s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Created reservations ['be6a8198-d58f-4d4b-996d-e44272705b5e', 'cf04dcfb-5b76-46e6-b0fc-86ac5cb6bf43', '667f90dd-6c32-48bb-bae1-b930720a7c62', '62de8ec3-a329-46e9-81b0-d8d6319e77c9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:04 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:53:04 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-ff428afc-e1d6-4d69-a341-f908f9f1a7d8-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-ff428afc-e1d6-4d69-a341-f908f9f1a7d8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:04 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.311s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-quobyte-ff428afc-e1d6-4d69-a341-f908f9f1a7d8" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:04 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Deleted volume successfully. Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-ff428afc-e1d6-4d69-a341-f908f9f1a7d8" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-01dcb550-fde4-44c2-9c17-727d5ee0b429 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-c0675fe8-22cc-496e-a1b1-8becc0ce3892-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b73f93a-5342-46df-973f-adde334b6b90]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:53:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:04 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 Jul 18 05:53:04 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:05 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8" returned: 0 in 0.398s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:05 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8 Jul 18 05:53:05 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:05 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ff428afc-e1d6-4d69-a341-f908f9f1a7d8" returned: 0 in 0.260s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-ff428afc-e1d6-4d69-a341-f908f9f1a7d8" released by "delete_volume" :: held 0.756s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Created reservations ['dc9b4dfe-be54-40a0-8982-2f24661c1342', '7217f9be-e44d-4e05-baf1-6712e8dc8d40', 'fd4dfe38-a20d-4f7e-8319-8fb7c93988fa', 'ddf1e2f0-5df4-43fb-a324-9b2179763285'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:05 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:53:05 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-e083f8c1-5ac6-4218-8630-0a5d0ade0175-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-e083f8c1-5ac6-4218-8630-0a5d0ade0175-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-quobyte-e083f8c1-5ac6-4218-8630-0a5d0ade0175" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:05 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.297s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:53:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Deleted volume successfully. Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-e083f8c1-5ac6-4218-8630-0a5d0ade0175" acquired by "delete_volume" :: waited 0.036s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-b3e58314-c0a7-424c-b529-9c1f37825c16 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-ff428afc-e1d6-4d69-a341-f908f9f1a7d8-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea5c221-e0cd-483b-907e-df859848c95f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:53:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:06 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 Jul 18 05:53:06 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:06 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:53:06 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:06 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175" returned: 0 in 0.458s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:06 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175 Jul 18 05:53:06 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:06 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.282s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:53:06 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e083f8c1-5ac6-4218-8630-0a5d0ade0175" returned: 0 in 0.263s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-e083f8c1-5ac6-4218-8630-0a5d0ade0175" released by "delete_volume" :: held 0.789s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Created reservations ['0f826b41-ca42-42ca-a625-6a21347e52e7', 'e49d40a7-993e-46f3-a91d-7cf4eb424e94', 'd74bb926-d3d9-42af-b20d-8a47265c4247', '3ab34113-3697-4223-8503-b9de950dcdf9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:06 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:53:06 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-7c354d32-c4f5-4745-b591-5825f8b9d018-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-7c354d32-c4f5-4745-b591-5825f8b9d018-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-quobyte-14931e37-c008-43a5-b7b7-2c78eeccc7ef" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-14931e37-c008-43a5-b7b7-2c78eeccc7ef" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-quobyte-7c354d32-c4f5-4745-b591-5825f8b9d018" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-7c354d32-c4f5-4745-b591-5825f8b9d018" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:06 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Deleting offline snapshot 7c354d32-c4f5-4745-b591-5825f8b9d018 of volume 14931e37-c008-43a5-b7b7-2c78eeccc7ef {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] snapshot_file for this snap is: volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.307s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:53:07 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Deleted volume successfully. Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=133,cinder:UPDATE=168,cinder:INSERT=46,cinder:DELETE=16 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c91455-2e67-4a22-b24d-ec1c857cdae9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79e6f1d1-aa44-480d-8445-71d2ac7193c3 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-e083f8c1-5ac6-4218-8630-0a5d0ade0175-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:07 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 Jul 18 05:53:07 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:07 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018" returned: 0 in 0.371s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7408b0-39db-49c0-a953-224ed145b357]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:07 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef Jul 18 05:53:07 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:07 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef" returned: 0 in 0.366s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:07 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 Jul 18 05:53:07 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:08 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018" returned: 0 in 0.376s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:08 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018 Jul 18 05:53:08 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:08 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef.7c354d32-c4f5-4745-b591-5825f8b9d018" returned: 0 in 0.245s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:08 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=134,cinder:UPDATE=184,cinder:INSERT=42,cinder:DELETE=15 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:53:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-7c354d32-c4f5-4745-b591-5825f8b9d018" released by "_delete_snapshot" :: held 1.490s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-14931e37-c008-43a5-b7b7-2c78eeccc7ef" released by "delete_snapshot" :: held 1.526s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:08 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Created reservations ['68fa1034-ca84-4fca-98f6-cfeb8058165c', 'a1b0f319-795c-4a9c-beef-cacbe5cd1ec5', '7ae6dedb-5988-4e59-8fd7-7a7182900ca8', '4490c8e6-6217-4693-9f72-5205584d11e6'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:53:08 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Delete snapshot completed successfully. Jul 18 05:53:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-289eba3c-0226-468a-b345-9a54b0d145c4 tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-7c354d32-c4f5-4745-b591-5825f8b9d018-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-14931e37-c008-43a5-b7b7-2c78eeccc7ef-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-14931e37-c008-43a5-b7b7-2c78eeccc7ef-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "cinder-quobyte-14931e37-c008-43a5-b7b7-2c78eeccc7ef" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-14931e37-c008-43a5-b7b7-2c78eeccc7ef" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[814ad7cf-0392-431f-9d5b-d680dd715859]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:09 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef Jul 18 05:53:09 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:09 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef" returned: 0 in 0.374s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:09 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef Jul 18 05:53:09 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:09 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-14931e37-c008-43a5-b7b7-2c78eeccc7ef" returned: 0 in 0.239s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-quobyte-14931e37-c008-43a5-b7b7-2c78eeccc7ef" released by "delete_volume" :: held 0.674s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Created reservations ['df2790e4-8627-4385-9a3c-dbf72156502a', '682576a3-7266-43f2-affd-8667e40096b8', 'a76d9aff-71ad-40f1-a238-26091ca9f6a2', 'ef66f2e2-cbb7-4ef9-bbd4-94eb349b6c08'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:53:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:53:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:10 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:53:10 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:10 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.283s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:10 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:53:10 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Deleted volume successfully. Jul 18 05:53:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3604bb1a-5691-47f6-9d1e-76c6c23550cb tempest-CreateVolumesFromSnapshotTest-358747059 None] Lock "cinder-14931e37-c008-43a5-b7b7-2c78eeccc7ef-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:53:17 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:53:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Flow 'volume_create_manager' (c82f23c7-27db-4219-a5a3-36c8e8934e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:53:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f0da2d-6e9e-4bb9-821f-15e259b0ff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:53:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f0da2d-6e9e-4bb9-821f-15e259b0ff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-52233377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23dd751-683b-4cbe-b32c-34f9382feeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8329d15d6514581a148fe4a8952220e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:53:18Z,use_quota=True,user_id='14f006052581485b9b4a7593ba6d9d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:53:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd391075-d4cf-4947-8e5d-fa5d0e4e2655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:53:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd391075-d4cf-4947-8e5d-fa5d0e4e2655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:53:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7405287-d605-4075-a917-1e06f45b1d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:53:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7405287-d605-4075-a917-1e06f45b1d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c23dd751-683b-4cbe-b32c-34f9382feeb1', 'volume_name': 'volume-c23dd751-683b-4cbe-b32c-34f9382feeb1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:53:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd9fe9e-5f6d-4859-bb0a-d7027c304111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd9fe9e-5f6d-4859-bb0a-d7027c304111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7999fbac-28b1-4985-857c-d3be09959979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:53:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Volume c23dd751-683b-4cbe-b32c-34f9382feeb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c23dd751-683b-4cbe-b32c-34f9382feeb1', 'volume_size': 1} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-52233377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23dd751-683b-4cbe-b32c-34f9382feeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8329d15d6514581a148fe4a8952220e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:53:18Z,use_quota=True,user_id='14f006052581485b9b4a7593ba6d9d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Creating volume c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:53:18 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:18 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 1073741824 Jul 18 05:53:18 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:18 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 1073741824" returned: 0 in 0.437s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:18 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 Jul 18 05:53:18 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:18 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1" returned: 0 in 0.252s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7999fbac-28b1-4985-857c-d3be09959979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c23dd751-683b-4cbe-b32c-34f9382feeb1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e0ae18-f336-4df8-81e0-2f5e1c76265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:53:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Volume volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 (c23dd751-683b-4cbe-b32c-34f9382feeb1): created successfully Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e0ae18-f336-4df8-81e0-2f5e1c76265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:53:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Flow 'volume_create_manager' (c82f23c7-27db-4219-a5a3-36c8e8934e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:53:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f5b97a95-4181-4458-a4b7-e9312abc5cfe tempest-TestStampPattern-828100581 None] Created volume successfully. Jul 18 05:53:28 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=18 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:53:31 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:53:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e69edc69-1b30-4ba3-b19e-8256ad248022 req-8bd7fd49-d9c5-48ec-9f78-6ed13f275019 tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e69edc69-1b30-4ba3-b19e-8256ad248022 req-8bd7fd49-d9c5-48ec-9f78-6ed13f275019 tempest-TestStampPattern-828100581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-e69edc69-1b30-4ba3-b19e-8256ad248022 req-8bd7fd49-d9c5-48ec-9f78-6ed13f275019 tempest-TestStampPattern-828100581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:47 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-e69edc69-1b30-4ba3-b19e-8256ad248022 req-8bd7fd49-d9c5-48ec-9f78-6ed13f275019 tempest-TestStampPattern-828100581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-c23dd751-683b-4cbe-b32c-34f9382feeb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28d77a91-6b73-404a-a0b5-61597f7dd5af', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:53:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-e69edc69-1b30-4ba3-b19e-8256ad248022 req-8bd7fd49-d9c5-48ec-9f78-6ed13f275019 tempest-TestStampPattern-828100581 None] attachment_update completed successfully. Jul 18 05:53:51 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-13142879-90ee-4939-9cde-4e536b8b3e0e req-5ec1bdbf-8e78-4c5a-972c-9b3a50cd085e tempest-TestStampPattern-828100581 None] Terminate volume connection completed successfully. Jul 18 05:53:51 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-13142879-90ee-4939-9cde-4e536b8b3e0e req-5ec1bdbf-8e78-4c5a-972c-9b3a50cd085e tempest-TestStampPattern-828100581 None] Deleting attachment 28d77a91-6b73-404a-a0b5-61597f7dd5af. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:53:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:53:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:53:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Creating offline snapshot e26f5a1e-f8c8-4906-a7d5-b3b82016f3af of volume c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:53:52 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f0cb6d-63b6-47ac-8019-fbdac5a58707]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:53:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:52 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 Jul 18 05:53:52 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:52 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1" returned: 0 in 0.349s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:52 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af 1G Jul 18 05:53:52 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:52 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af 1G" returned: 0 in 0.383s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:52 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af Jul 18 05:53:52 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:53 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af" returned: 0 in 0.275s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:53 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af is being set with open permissions: ugo+rw Jul 18 05:53:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:53 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af Jul 18 05:53:53 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:53 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af" returned: 0 in 0.236s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:53 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.info Jul 18 05:53:53 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:53 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.info" returned: 0 in 0.246s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:53 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.info is being set with open permissions: ugo+rw Jul 18 05:53:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:53 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.info Jul 18 05:53:53 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:53 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.info" returned: 0 in 0.237s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:53:54 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-73b0e784-3b99-4200-9331-36de39f48d50 tempest-TestStampPattern-828100581 None] Create snapshot completed successfully Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Flow 'volume_create_manager' (42fe60de-ef3a-42e4-a9e1-9d1f6cf936d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10829ba-6dcb-409d-9e3e-61eb450c0597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10829ba-6dcb-409d-9e3e-61eb450c0597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-264919271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95cda76-142b-4b88-a85f-93f95275fe62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8329d15d6514581a148fe4a8952220e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e26f5a1e-f8c8-4906-a7d5-b3b82016f3af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:54:01Z,use_quota=True,user_id='14f006052581485b9b4a7593ba6d9d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47055fcb-b0d8-4e76-abca-f4b81ace4576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47055fcb-b0d8-4e76-abca-f4b81ace4576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10417c02-450e-4e16-82de-f62c3388f0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10417c02-450e-4e16-82de-f62c3388f0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b95cda76-142b-4b88-a85f-93f95275fe62', 'volume_name': 'volume-b95cda76-142b-4b88-a85f-93f95275fe62', 'volume_size': 1, 'snapshot_id': 'e26f5a1e-f8c8-4906-a7d5-b3b82016f3af'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432b9056-0b80-4ad4-b76e-32073214a425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432b9056-0b80-4ad4-b76e-32073214a425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddeff361-5731-41ff-97ad-2ff8bf99b31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:54:00 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Volume b95cda76-142b-4b88-a85f-93f95275fe62: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b95cda76-142b-4b88-a85f-93f95275fe62', 'volume_size': 1, 'snapshot_id': 'e26f5a1e-f8c8-4906-a7d5-b3b82016f3af'} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Acquiring lock "cinder-quobyte-e26f5a1e-f8c8-4906-a7d5-b3b82016f3af-b95cda76-142b-4b88-a85f-93f95275fe62" by "_create_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-e26f5a1e-f8c8-4906-a7d5-b3b82016f3af-b95cda76-142b-4b88-a85f-93f95275fe62" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Creating volume b95cda76-142b-4b88-a85f-93f95275fe62 from snapshot e26f5a1e-f8c8-4906-a7d5-b3b82016f3af {{(pid=87497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Acquiring lock "cinder-quobyte-b95cda76-142b-4b88-a85f-93f95275fe62" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-b95cda76-142b-4b88-a85f-93f95275fe62" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] snapshot: e26f5a1e-f8c8-4906-a7d5-b3b82016f3af, volume: b95cda76-142b-4b88-a85f-93f95275fe62, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:54:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[44986240-2f27-4643-918e-9e03956fe918]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:01 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af Jul 18 05:54:01 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:01 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af" returned: 0 in 0.365s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c23dd751-683b-4cbe-b32c-34f9382feeb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a061bd92-4cbd-43a8-9d59-7f68e0909d24]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:01 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 Jul 18 05:54:01 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:01 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1" returned: 0 in 0.381s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:54:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:01 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 Jul 18 05:54:01 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:06 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:54:06 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:06 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.697s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:54:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:54:07 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62" returned: 0 in 5.915s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:07 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c9ec0e-c13a-4b79-834c-145c826dfbe5]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:54:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:07 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 Jul 18 05:54:07 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:08 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1" returned: 0 in 0.601s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:54:08 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Converted 1024.00 MB image at 173.09 MB/s Jul 18 05:54:08 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 is being set with open permissions: ugo+rw Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:08 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 Jul 18 05:54:08 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:08 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62" returned: 0 in 0.293s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-b95cda76-142b-4b88-a85f-93f95275fe62" released by "_copy_volume_from_snapshot" :: held 7.690s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-e26f5a1e-f8c8-4906-a7d5-b3b82016f3af-b95cda76-142b-4b88-a85f-93f95275fe62" released by "_create_volume_from_snapshot" :: held 7.735s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.752s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddeff361-5731-41ff-97ad-2ff8bf99b31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95cda76-142b-4b88-a85f-93f95275fe62', 'volume_size': 1, 'snapshot_id': 'e26f5a1e-f8c8-4906-a7d5-b3b82016f3af'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015700a8-325c-43cd-a61a-3f3702d2a760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:54:08 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Volume volume-b95cda76-142b-4b88-a85f-93f95275fe62 (b95cda76-142b-4b88-a85f-93f95275fe62): created successfully Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015700a8-325c-43cd-a61a-3f3702d2a760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:54:08 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Flow 'volume_create_manager' (42fe60de-ef3a-42e4-a9e1-9d1f6cf936d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:54:08 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a52929dc-8818-4fae-a637-93cf45c2f174 tempest-TestStampPattern-828100581 None] Created volume successfully. Jul 18 05:54:18 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:54:18 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:54:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-d5a1180f-a14c-45d0-87e8-515a60204d2c req-3c8753a4-75c1-415f-a242-abafa4f33ea9 tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:54:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-d5a1180f-a14c-45d0-87e8-515a60204d2c req-3c8753a4-75c1-415f-a242-abafa4f33ea9 tempest-TestStampPattern-828100581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:54:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4fc381-bd5a-479c-8940-f966b9a72871]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:54:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-d5a1180f-a14c-45d0-87e8-515a60204d2c req-3c8753a4-75c1-415f-a242-abafa4f33ea9 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:50 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 Jul 18 05:54:50 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:50 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [req-d5a1180f-a14c-45d0-87e8-515a60204d2c req-3c8753a4-75c1-415f-a242-abafa4f33ea9 tempest-TestStampPattern-828100581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62" returned: 0 in 0.360s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [req-d5a1180f-a14c-45d0-87e8-515a60204d2c req-3c8753a4-75c1-415f-a242-abafa4f33ea9 tempest-TestStampPattern-828100581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.388s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:54:50 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-d5a1180f-a14c-45d0-87e8-515a60204d2c req-3c8753a4-75c1-415f-a242-abafa4f33ea9 tempest-TestStampPattern-828100581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13', 'name': 'volume-b95cda76-142b-4b88-a85f-93f95275fe62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e000944c-2c63-4bea-8026-516961b09c7d', 'enforce_multipath': True} {{(pid=87497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:54:51 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-d5a1180f-a14c-45d0-87e8-515a60204d2c req-3c8753a4-75c1-415f-a242-abafa4f33ea9 tempest-TestStampPattern-828100581 None] attachment_update completed successfully. Jul 18 05:54:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [req-15501f51-6697-4aed-bb68-9936ed3ad100 req-7386a4f7-d9e7-46e6-b4ea-e2469d486e58 tempest-TestStampPattern-828100581 None] Terminate volume connection completed successfully. Jul 18 05:54:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [req-15501f51-6697-4aed-bb68-9936ed3ad100 req-7386a4f7-d9e7-46e6-b4ea-e2469d486e58 tempest-TestStampPattern-828100581 None] Deleting attachment e000944c-2c63-4bea-8026-516961b09c7d. {{(pid=87497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Acquiring lock "cinder-b95cda76-142b-4b88-a85f-93f95275fe62-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Lock "cinder-b95cda76-142b-4b88-a85f-93f95275fe62-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Acquiring lock "cinder-quobyte-b95cda76-142b-4b88-a85f-93f95275fe62" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-b95cda76-142b-4b88-a85f-93f95275fe62" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[992c41f9-e64f-4170-904a-a21390d2bae9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:58 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 Jul 18 05:54:58 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:58 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62" returned: 0 in 0.367s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:58 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62 Jul 18 05:54:58 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:58 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b95cda76-142b-4b88-a85f-93f95275fe62" returned: 0 in 0.245s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-b95cda76-142b-4b88-a85f-93f95275fe62" released by "delete_volume" :: held 0.651s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Created reservations ['3dc90922-6b6a-4859-a86e-60998c7bb0ad', 'd8710fb0-a1fc-4aa6-b8d3-514da47e8ec3', 'dae0eebb-c3da-4223-8a31-042afb8a45b5', 'e7b786a1-c8ca-4eaa-89ef-3a4d71930ff0'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:54:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:58 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:54:58 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:59 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.241s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:54:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Deleted volume successfully. Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2001ee0e-ab22-450f-9f1d-fac400acbfe3 tempest-TestStampPattern-828100581 None] Lock "cinder-b95cda76-142b-4b88-a85f-93f95275fe62-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Acquiring lock "cinder-e26f5a1e-f8c8-4906-a7d5-b3b82016f3af-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Lock "cinder-e26f5a1e-f8c8-4906-a7d5-b3b82016f3af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Acquiring lock "cinder-quobyte-c23dd751-683b-4cbe-b32c-34f9382feeb1" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-c23dd751-683b-4cbe-b32c-34f9382feeb1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Acquiring lock "cinder-quobyte-e26f5a1e-f8c8-4906-a7d5-b3b82016f3af" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-e26f5a1e-f8c8-4906-a7d5-b3b82016f3af" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Deleting offline snapshot e26f5a1e-f8c8-4906-a7d5-b3b82016f3af of volume c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] snapshot_file for this snap is: volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e35e0-3cdf-4f91-b9b7-97393fbf5e58]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:59 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af Jul 18 05:54:59 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:59 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af" returned: 0 in 0.348s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c23dd751-683b-4cbe-b32c-34f9382feeb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d8401d-529c-4d4f-8df3-60f2b39d790f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:54:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:00 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 Jul 18 05:55:00 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:00 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1" returned: 0 in 0.364s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:00 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af Jul 18 05:55:00 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:00 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af" returned: 0 in 0.326s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:00 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af Jul 18 05:55:00 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:00 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1.e26f5a1e-f8c8-4906-a7d5-b3b82016f3af" returned: 0 in 0.237s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-e26f5a1e-f8c8-4906-a7d5-b3b82016f3af" released by "_delete_snapshot" :: held 1.368s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-c23dd751-683b-4cbe-b32c-34f9382feeb1" released by "delete_snapshot" :: held 1.388s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:00 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Created reservations ['4876fe78-2e3d-489a-8db8-bfda85e21090', 'bc706727-ba2d-42aa-8e15-622a11a07cc4', '67250d7e-0c01-465f-b9a2-18832b94e6b6', '0eb82a4d-f372-4421-9d3c-9b483a0106ef'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:01 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Delete snapshot completed successfully. Jul 18 05:55:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4274317e-bd6a-4746-86a5-30b1fe5127bf tempest-TestStampPattern-828100581 None] Lock "cinder-e26f5a1e-f8c8-4906-a7d5-b3b82016f3af-delete_snapshot" released by "delete_snapshot" :: held 1.524s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Acquiring lock "cinder-c23dd751-683b-4cbe-b32c-34f9382feeb1-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Lock "cinder-c23dd751-683b-4cbe-b32c-34f9382feeb1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Acquiring lock "cinder-quobyte-c23dd751-683b-4cbe-b32c-34f9382feeb1" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-c23dd751-683b-4cbe-b32c-34f9382feeb1" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[717a70c5-3257-46b8-91f4-7385bbd6782a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:05 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 Jul 18 05:55:05 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:05 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1" returned: 0 in 0.361s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:05 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1 Jul 18 05:55:05 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:05 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c23dd751-683b-4cbe-b32c-34f9382feeb1" returned: 0 in 0.248s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Lock "cinder-quobyte-c23dd751-683b-4cbe-b32c-34f9382feeb1" released by "delete_volume" :: held 0.662s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Created reservations ['de17f1ec-0a0d-4ad1-abc7-bb97fdcedc97', 'a3bc3f45-a160-41e0-b11c-a568ceab561a', '4ca98f63-11a4-4d6a-8114-e617d4359b43', '724dd79f-5c8b-45d3-b26e-f2f654d0c23b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:05 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:05 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:06 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:06 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Deleted volume successfully. Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-1c0eb359-d668-43ed-87b0-031623575a19 tempest-TestStampPattern-828100581 None] Lock "cinder-c23dd751-683b-4cbe-b32c-34f9382feeb1-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:06 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:06 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:06 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.263s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:55:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (71642c27-80b5-427d-9583-a903668f1af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa05dd5-a8f7-48a8-9853-df47ca1f2129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=20,cinder:UPDATE=25,cinder:INSERT=4 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa05dd5-a8f7-48a8-9853-df47ca1f2129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273815322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ceb7cfd-0a3f-4399-a12c-ac7640a46632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:16Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebacfed5-6e13-400b-99d1-ec64cb8ba447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebacfed5-6e13-400b-99d1-ec64cb8ba447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af83c2a0-cbe8-42e1-9b87-9b080e04bc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af83c2a0-cbe8-42e1-9b87-9b080e04bc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ceb7cfd-0a3f-4399-a12c-ac7640a46632', 'volume_name': 'volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc9e6e5-cb29-4afa-903c-401db5f346b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc9e6e5-cb29-4afa-903c-401db5f346b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2124fba9-0b58-41f7-90aa-8128b31f5dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume 8ceb7cfd-0a3f-4399-a12c-ac7640a46632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632', 'volume_size': 1} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273815322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ceb7cfd-0a3f-4399-a12c-ac7640a46632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:16Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Creating volume 8ceb7cfd-0a3f-4399-a12c-ac7640a46632 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:15 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:15 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 1073741824 Jul 18 05:55:15 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:16 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 1073741824" returned: 0 in 0.418s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:16 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 Jul 18 05:55:16 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:16 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632" returned: 0 in 0.247s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:55:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2124fba9-0b58-41f7-90aa-8128b31f5dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e1af9f-0d97-4342-aae9-21049b1bf129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 (8ceb7cfd-0a3f-4399-a12c-ac7640a46632): created successfully Jul 18 05:55:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e1af9f-0d97-4342-aae9-21049b1bf129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (71642c27-80b5-427d-9583-a903668f1af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:16 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1b5b1792-090c-4a85-a540-c2fec87cc55e tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created volume successfully. Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (562c6529-efc9-492b-a88f-eebf7c91243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445257ae-192a-463b-aebc-bf346e29186d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445257ae-192a-463b-aebc-bf346e29186d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1949356362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ef966e-a9ee-4a03-9f69-46fe5442a282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:17Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72371f4c-f94c-4781-8508-2919fd1b5acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72371f4c-f94c-4781-8508-2919fd1b5acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60266b21-4fbe-450d-b618-a780cdece074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60266b21-4fbe-450d-b618-a780cdece074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ef966e-a9ee-4a03-9f69-46fe5442a282', 'volume_name': 'volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8698fa-2bce-4761-ac49-1585cf5ab31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8698fa-2bce-4761-ac49-1585cf5ab31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bac126-afdf-4bee-a183-5e44a5efd588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume c5ef966e-a9ee-4a03-9f69-46fe5442a282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282', 'volume_size': 1} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1949356362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ef966e-a9ee-4a03-9f69-46fe5442a282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:17Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Creating volume c5ef966e-a9ee-4a03-9f69-46fe5442a282 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:17 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:17 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 1073741824 Jul 18 05:55:17 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (0c5bc2c6-ac79-47d8-918a-ea9ce2f1aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1898a8a-3c0f-444b-ad78-7ad6606bead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1898a8a-3c0f-444b-ad78-7ad6606bead0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1623903732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863ff7ee-5c9c-4802-8027-0e69bfd4508b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:18Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff74e825-b513-4da2-9567-10bdda99645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff74e825-b513-4da2-9567-10bdda99645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681a870c-3cea-4fb1-a6b2-00bda0ba12c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681a870c-3cea-4fb1-a6b2-00bda0ba12c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '863ff7ee-5c9c-4802-8027-0e69bfd4508b', 'volume_name': 'volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3ef4ea-dc69-46aa-97a2-09a28f26ce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3ef4ea-dc69-46aa-97a2-09a28f26ce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a95a43b-9fc5-40b8-8409-1de73cd3f89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume 863ff7ee-5c9c-4802-8027-0e69bfd4508b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b', 'volume_size': 1} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:17 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 1073741824" returned: 0 in 0.507s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:17 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 Jul 18 05:55:17 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (301f38ef-af1d-4477-8512-7c2ff23cf618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a283cc53-7b21-41ed-980a-fd4fcec0b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a283cc53-7b21-41ed-980a-fd4fcec0b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110115867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80680d8-2b04-465b-b910-4d21e707b89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:18Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8bcebf-0095-459a-8e47-a957b69fc2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8bcebf-0095-459a-8e47-a957b69fc2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d777168c-19ac-4769-8d55-a780292e9281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d777168c-19ac-4769-8d55-a780292e9281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80680d8-2b04-465b-b910-4d21e707b89c', 'volume_name': 'volume-a80680d8-2b04-465b-b910-4d21e707b89c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b184ec6-fbed-43ce-b1d1-89b0e37b942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b184ec6-fbed-43ce-b1d1-89b0e37b942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4be01dd-a6c5-484d-b502-0a8d26e6d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume a80680d8-2b04-465b-b910-4d21e707b89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80680d8-2b04-465b-b910-4d21e707b89c', 'volume_size': 1} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:18 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282" returned: 0 in 0.299s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1623903732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863ff7ee-5c9c-4802-8027-0e69bfd4508b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:18Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Creating volume 863ff7ee-5c9c-4802-8027-0e69bfd4508b {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:18 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bac126-afdf-4bee-a183-5e44a5efd588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b 1073741824 Jul 18 05:55:18 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6712050d-1533-4fdc-bf8f-7c9187d4cc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 (c5ef966e-a9ee-4a03-9f69-46fe5442a282): created successfully Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6712050d-1533-4fdc-bf8f-7c9187d4cc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (562c6529-efc9-492b-a88f-eebf7c91243d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ad371ab7-3724-4481-9b1f-50fe18100b94 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created volume successfully. Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (cfb002e2-e93d-4bc2-a818-4855f03af7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1becc2fd-a897-4ae3-abc0-ef2a423058fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1becc2fd-a897-4ae3-abc0-ef2a423058fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797645230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef973e0-7761-4d71-aeb1-8347fbfebe0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:18Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8e00e5-4330-40ca-8362-1094c392294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8e00e5-4330-40ca-8362-1094c392294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6182a5d-901c-41cf-8fd0-5eff31e27ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6182a5d-901c-41cf-8fd0-5eff31e27ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef973e0-7761-4d71-aeb1-8347fbfebe0b', 'volume_name': 'volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffe5fca-5556-4ec0-9551-bb14d11bec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffe5fca-5556-4ec0-9551-bb14d11bec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37768bf2-a3d9-4d20-90c5-fa0b2f0cb426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume aef973e0-7761-4d71-aeb1-8347fbfebe0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b', 'volume_size': 1} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:18 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b 1073741824" returned: 0 in 0.533s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (6aecde06-1cef-408f-931f-32edd7ca5b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0958880d-3980-47cf-8141-9196dc091f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0958880d-3980-47cf-8141-9196dc091f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1924044765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1bc687-c398-4765-a6bb-1dca23ac0e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:19Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10564439-cb91-4389-a63c-d29a1a4de5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10564439-cb91-4389-a63c-d29a1a4de5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c8772f-79d2-430c-9af3-6c4184c01e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c8772f-79d2-430c-9af3-6c4184c01e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1bc687-c398-4765-a6bb-1dca23ac0e0f', 'volume_name': 'volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4556831-fdc9-4792-8332-812be2481e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4556831-fdc9-4792-8332-812be2481e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ad6bd6-d83f-4064-9bc8-7aa5519eb6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume bb1bc687-c398-4765-a6bb-1dca23ac0e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f', 'volume_size': 1} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:18 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b Jul 18 05:55:18 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:19 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b" returned: 0 in 0.243s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110115867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80680d8-2b04-465b-b910-4d21e707b89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:18Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Creating volume a80680d8-2b04-465b-b910-4d21e707b89c {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:19 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a95a43b-9fc5-40b8-8409-1de73cd3f89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd671e2-d060-4892-96e6-ea9978981e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:19 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c 1073741824 Jul 18 05:55:19 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:19 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b (863ff7ee-5c9c-4802-8027-0e69bfd4508b): created successfully Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd671e2-d060-4892-96e6-ea9978981e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (0c5bc2c6-ac79-47d8-918a-ea9ce2f1aa20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5b40f02f-dc19-4003-9900-3bd858d9c7c5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created volume successfully. Jul 18 05:55:19 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c 1073741824" returned: 0 in 0.399s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:19 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c Jul 18 05:55:19 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:19 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c" returned: 0 in 0.256s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.328s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797645230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef973e0-7761-4d71-aeb1-8347fbfebe0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:18Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Creating volume aef973e0-7761-4d71-aeb1-8347fbfebe0b {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:19 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4be01dd-a6c5-484d-b502-0a8d26e6d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80680d8-2b04-465b-b910-4d21e707b89c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:19 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b 1073741824 Jul 18 05:55:19 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2857ee4-a622-4dc9-a316-a0264bdd3f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:19 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume volume-a80680d8-2b04-465b-b910-4d21e707b89c (a80680d8-2b04-465b-b910-4d21e707b89c): created successfully Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2857ee4-a622-4dc9-a316-a0264bdd3f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (301f38ef-af1d-4477-8512-7c2ff23cf618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-1a2fb29e-c452-4350-8d82-a6e717713021 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created volume successfully. Jul 18 05:55:20 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b 1073741824" returned: 0 in 0.401s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:20 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b Jul 18 05:55:20 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:20 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b" returned: 0 in 0.239s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.634s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1924044765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1bc687-c398-4765-a6bb-1dca23ac0e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e1ba919bb34c118b2da6d372c815d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:19Z,use_quota=True,user_id='705ca2d4bd9d470cb46d23b3aea95b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Creating volume bb1bc687-c398-4765-a6bb-1dca23ac0e0f {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:20 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37768bf2-a3d9-4d20-90c5-fa0b2f0cb426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:20 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f 1073741824 Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f641c4e-73b0-4b8e-89fe-7f07205853ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:20 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:20 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b (aef973e0-7761-4d71-aeb1-8347fbfebe0b): created successfully Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f641c4e-73b0-4b8e-89fe-7f07205853ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (cfb002e2-e93d-4bc2-a818-4855f03af7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-54bf5209-d86d-427d-9245-afc099e4d0ee tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created volume successfully. Jul 18 05:55:20 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f 1073741824" returned: 0 in 0.425s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:21 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f Jul 18 05:55:21 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:21 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:55:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ad6bd6-d83f-4064-9bc8-7aa5519eb6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d5fa5f-0239-417d-9af8-e1187b1c476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Volume volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f (bb1bc687-c398-4765-a6bb-1dca23ac0e0f): created successfully Jul 18 05:55:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d5fa5f-0239-417d-9af8-e1187b1c476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Flow 'volume_create_manager' (6aecde06-1cef-408f-931f-32edd7ca5b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e88c660c-bb48-47ad-8537-8725d4e25f6a tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created volume successfully. Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-bb1bc687-c398-4765-a6bb-1dca23ac0e0f-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-bb1bc687-c398-4765-a6bb-1dca23ac0e0f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-quobyte-bb1bc687-c398-4765-a6bb-1dca23ac0e0f" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-bb1bc687-c398-4765-a6bb-1dca23ac0e0f" acquired by "delete_volume" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6165a7-9185-4537-a02c-690ab73a3734]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:22 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f Jul 18 05:55:22 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:22 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f" returned: 0 in 0.342s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:22 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f Jul 18 05:55:22 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:22 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-bb1bc687-c398-4765-a6bb-1dca23ac0e0f" returned: 0 in 0.244s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-bb1bc687-c398-4765-a6bb-1dca23ac0e0f" released by "delete_volume" :: held 0.623s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created reservations ['a95a115a-ef7e-47c3-a175-094b860b21f2', '1478b695-181e-40ad-9ee6-7ecefe78b235', '6840f176-0ec7-4590-928e-cb06316cffaf', '30a66c62-ce77-450a-83ed-7cb95b77e862'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:22 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:22 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:23 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.237s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:23 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Deleted volume successfully. Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-905ccdc8-c95e-441c-ad2a-aa4164e0d7c6 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-bb1bc687-c398-4765-a6bb-1dca23ac0e0f-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-aef973e0-7761-4d71-aeb1-8347fbfebe0b-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-aef973e0-7761-4d71-aeb1-8347fbfebe0b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-quobyte-aef973e0-7761-4d71-aeb1-8347fbfebe0b" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-aef973e0-7761-4d71-aeb1-8347fbfebe0b" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceef85b-02c0-49da-a4dc-e0b6aeae1199]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:23 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b Jul 18 05:55:23 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:23 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b" returned: 0 in 0.346s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:23 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b Jul 18 05:55:23 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:23 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aef973e0-7761-4d71-aeb1-8347fbfebe0b" returned: 0 in 0.236s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-aef973e0-7761-4d71-aeb1-8347fbfebe0b" released by "delete_volume" :: held 0.622s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created reservations ['c92e719d-671b-4582-8500-7e21667a6e6b', 'f0ae9743-e7a3-4709-bc0e-a53102fd18de', '0865f37c-e3ba-477d-8927-e7d9e99e9c63', '2f71d957-5d02-4723-9e1b-7ad5a3bd18cd'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:24 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:24 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:24 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.251s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:24 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Deleted volume successfully. Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e91d21b-8efa-4a35-a45c-31bd1abb02fa tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-aef973e0-7761-4d71-aeb1-8347fbfebe0b-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-a80680d8-2b04-465b-b910-4d21e707b89c-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-a80680d8-2b04-465b-b910-4d21e707b89c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-quobyte-a80680d8-2b04-465b-b910-4d21e707b89c" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-a80680d8-2b04-465b-b910-4d21e707b89c" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9a9792-dc8d-444c-8d7b-07fa3959c58d]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:24 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c Jul 18 05:55:24 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:24 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c" returned: 0 in 0.348s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:24 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c Jul 18 05:55:24 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:25 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-a80680d8-2b04-465b-b910-4d21e707b89c" returned: 0 in 0.238s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-a80680d8-2b04-465b-b910-4d21e707b89c" released by "delete_volume" :: held 0.623s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created reservations ['a810b2d7-3596-43a5-8175-f855dee5cb77', 'a7fee373-eb00-4717-b429-54522a4dc853', '7fe92599-b5d6-4f6b-b7a4-73290d56eb43', '80323971-3d29-41f8-9bd0-ad4af7dcb52e'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:25 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:25 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:25 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.234s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:25 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Deleted volume successfully. Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6b00a388-2589-4f65-bd64-cab4bf419cca tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-a80680d8-2b04-465b-b910-4d21e707b89c-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-863ff7ee-5c9c-4802-8027-0e69bfd4508b-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-863ff7ee-5c9c-4802-8027-0e69bfd4508b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-quobyte-863ff7ee-5c9c-4802-8027-0e69bfd4508b" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-863ff7ee-5c9c-4802-8027-0e69bfd4508b" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dacfda-3cb3-4476-8374-399a8022718f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:25 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b Jul 18 05:55:25 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:26 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b" returned: 0 in 0.360s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:26 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b Jul 18 05:55:26 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:26 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-863ff7ee-5c9c-4802-8027-0e69bfd4508b" returned: 0 in 0.246s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-863ff7ee-5c9c-4802-8027-0e69bfd4508b" released by "delete_volume" :: held 0.652s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created reservations ['adfb43aa-071c-4165-9279-59d8ad3b5724', 'eb7b38f6-a3ae-4aed-a085-f776301f48c1', '4d47037c-6de5-4173-9c56-c6bfb78c5dcd', 'bae09cab-7415-4d7d-ad2e-93545bc55b46'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:26 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:26 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:26 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.244s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Deleted volume successfully. Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-38968765-9ef7-401a-9619-6b05211d2d20 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-863ff7ee-5c9c-4802-8027-0e69bfd4508b-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-c5ef966e-a9ee-4a03-9f69-46fe5442a282-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-c5ef966e-a9ee-4a03-9f69-46fe5442a282-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-quobyte-c5ef966e-a9ee-4a03-9f69-46fe5442a282" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-c5ef966e-a9ee-4a03-9f69-46fe5442a282" acquired by "delete_volume" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafefaeb-3dfa-4c0c-b2d3-a0ba8d86d8de]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:26 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 Jul 18 05:55:26 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:27 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282" returned: 0 in 0.348s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:27 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282 Jul 18 05:55:27 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:27 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-c5ef966e-a9ee-4a03-9f69-46fe5442a282" returned: 0 in 0.248s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-c5ef966e-a9ee-4a03-9f69-46fe5442a282" released by "delete_volume" :: held 0.631s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created reservations ['be6bd11e-6281-4e67-a23b-8984d8717bc5', '8f06dc12-a4bb-4c89-976a-27007a9b1869', '16d91042-ad39-4d24-a97b-25e12ef60194', '2ecd9a84-002f-4d5b-940a-f8f2fe3a2241'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:27 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:27 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:27 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.241s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:27 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Deleted volume successfully. Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bdaf2b47-f31f-4a8b-bdc7-121ba75a2e95 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-c5ef966e-a9ee-4a03-9f69-46fe5442a282-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-8ceb7cfd-0a3f-4399-a12c-ac7640a46632-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-8ceb7cfd-0a3f-4399-a12c-ac7640a46632-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "cinder-quobyte-8ceb7cfd-0a3f-4399-a12c-ac7640a46632" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-8ceb7cfd-0a3f-4399-a12c-ac7640a46632" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c909115-67f9-491c-b9b3-4009f85cf8b9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:28 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 Jul 18 05:55:28 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:28 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632" returned: 0 in 0.347s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:28 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632 Jul 18 05:55:28 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:28 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ceb7cfd-0a3f-4399-a12c-ac7640a46632" returned: 0 in 0.238s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-quobyte-8ceb7cfd-0a3f-4399-a12c-ac7640a46632" released by "delete_volume" :: held 0.625s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Created reservations ['552f1796-a42e-4d8d-bd97-8e68ac2c051f', 'cb05786d-12c9-41de-a930-bc218fb4f9fb', '59b1999f-217a-4465-9a7b-663f68104299', 'eac32350-c807-4753-9160-140e2e1368fe'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:28 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:28 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:28 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.231s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:28 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Deleted volume successfully. Jul 18 05:55:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-946a797c-0c34-4afd-95ac-ac6db8cb4fe5 tempest-CreateVolumesFromSourceVolumeTest-399608762 None] Lock "cinder-8ceb7cfd-0a3f-4399-a12c-ac7640a46632-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Flow 'volume_create_manager' (57bac399-34c1-408d-9441-c6c87067c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207409ec-5c9d-45a1-9935-1bad411f830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207409ec-5c9d-45a1-9935-1bad411f830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-340567518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5039aac-5721-4011-8640-8b50815b9257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2aa3b53c524ea6a9d4cf2230861b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:32Z,use_quota=True,user_id='b9e80c1cbfd14007a8e322b30ce454c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad364af-0fb2-4ba7-a62d-d392339c069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad364af-0fb2-4ba7-a62d-d392339c069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c61e04-20b3-4a20-ab0e-472cf2c965be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c61e04-20b3-4a20-ab0e-472cf2c965be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5039aac-5721-4011-8640-8b50815b9257', 'volume_name': 'volume-f5039aac-5721-4011-8640-8b50815b9257', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b08606-8c8e-482f-a040-1b1f9c3b387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b08606-8c8e-482f-a040-1b1f9c3b387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186f5b43-cf01-4dc8-8b31-32dd552305d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Volume f5039aac-5721-4011-8640-8b50815b9257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5039aac-5721-4011-8640-8b50815b9257', 'volume_size': 1} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-340567518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5039aac-5721-4011-8640-8b50815b9257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2aa3b53c524ea6a9d4cf2230861b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:32Z,use_quota=True,user_id='b9e80c1cbfd14007a8e322b30ce454c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Creating volume f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:31 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:31 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 1073741824 Jul 18 05:55:31 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:32 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 1073741824" returned: 0 in 0.423s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:32 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 Jul 18 05:55:32 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:32 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257" returned: 0 in 0.246s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186f5b43-cf01-4dc8-8b31-32dd552305d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5039aac-5721-4011-8640-8b50815b9257', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26202fd9-0b39-4ebd-8520-0301893b2a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Volume volume-f5039aac-5721-4011-8640-8b50815b9257 (f5039aac-5721-4011-8640-8b50815b9257): created successfully Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26202fd9-0b39-4ebd-8520-0301893b2a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Flow 'volume_create_manager' (57bac399-34c1-408d-9441-c6c87067c25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2c992d90-7cc4-4d52-89c3-12848853474b tempest-VolumeDependencyTests-1023270415 None] Created volume successfully. Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Creating offline snapshot 8e3cc2ea-e140-4695-aab1-d26bb8999e22 of volume f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[01168784-eb6c-470f-9a9e-da85d65f61e0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:32 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 Jul 18 05:55:32 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:33 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257" returned: 0 in 0.354s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:33 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 1G Jul 18 05:55:33 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:33 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 1G" returned: 0 in 0.373s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5039aac-5721-4011-8640-8b50815b9257 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:33 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5039aac-5721-4011-8640-8b50815b9257 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 Jul 18 05:55:33 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:33 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5039aac-5721-4011-8640-8b50815b9257 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22" returned: 0 in 0.278s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:33 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 is being set with open permissions: ugo+rw Jul 18 05:55:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:33 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 Jul 18 05:55:33 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:34 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22" returned: 0 in 0.263s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:34 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.info Jul 18 05:55:34 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:34 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.info" returned: 0 in 0.254s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:34 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.info is being set with open permissions: ugo+rw Jul 18 05:55:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:34 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.info Jul 18 05:55:34 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:34 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.info" returned: 0 in 0.247s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:34 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c3a6fe00-71a8-4f79-8e8c-e3faf4bf7a97 tempest-VolumeDependencyTests-1023270415 None] Create snapshot completed successfully Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Flow 'volume_create_manager' (f735ee0c-2eb0-43cd-9263-0506a283a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a66a358-618d-49dd-8cf9-90776fcb57a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a66a358-618d-49dd-8cf9-90776fcb57a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-816378935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdeb2951-c569-45f1-aa04-9a82993b86c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2aa3b53c524ea6a9d4cf2230861b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e3cc2ea-e140-4695-aab1-d26bb8999e22,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:35Z,use_quota=True,user_id='b9e80c1cbfd14007a8e322b30ce454c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cad7d0-bb7d-4af7-8d3c-7f3930fbf99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cad7d0-bb7d-4af7-8d3c-7f3930fbf99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5e3021-7866-4414-8cf7-727961fb11b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5e3021-7866-4414-8cf7-727961fb11b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cdeb2951-c569-45f1-aa04-9a82993b86c1', 'volume_name': 'volume-cdeb2951-c569-45f1-aa04-9a82993b86c1', 'volume_size': 1, 'snapshot_id': '8e3cc2ea-e140-4695-aab1-d26bb8999e22'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ad2339-d03c-49e3-aad2-92cc38b989fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ad2339-d03c-49e3-aad2-92cc38b989fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a00af6-1d3f-4f23-b888-8fd91749cff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:35 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Volume cdeb2951-c569-45f1-aa04-9a82993b86c1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cdeb2951-c569-45f1-aa04-9a82993b86c1', 'volume_size': 1, 'snapshot_id': '8e3cc2ea-e140-4695-aab1-d26bb8999e22'} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "cinder-quobyte-8e3cc2ea-e140-4695-aab1-d26bb8999e22-cdeb2951-c569-45f1-aa04-9a82993b86c1" by "_create_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-8e3cc2ea-e140-4695-aab1-d26bb8999e22-cdeb2951-c569-45f1-aa04-9a82993b86c1" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Creating volume cdeb2951-c569-45f1-aa04-9a82993b86c1 from snapshot 8e3cc2ea-e140-4695-aab1-d26bb8999e22 {{(pid=87497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "cinder-quobyte-cdeb2951-c569-45f1-aa04-9a82993b86c1" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-cdeb2951-c569-45f1-aa04-9a82993b86c1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] snapshot: 8e3cc2ea-e140-4695-aab1-d26bb8999e22, volume: cdeb2951-c569-45f1-aa04-9a82993b86c1, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[59164571-5e7a-42be-b84d-6e1952c54f24]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:35 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 Jul 18 05:55:35 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:35 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22" returned: 0 in 0.351s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5039aac-5721-4011-8640-8b50815b9257(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d33c4d-e5e5-4ff0-b2d9-05ab685318e7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:36 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 Jul 18 05:55:36 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:36 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257" returned: 0 in 0.357s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:36 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:55:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:36 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 Jul 18 05:55:36 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:40 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1" returned: 0 in 4.112s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:40 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d158075b-c69f-4aa7-81d3-9da145f4de97]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:40 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 Jul 18 05:55:40 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:41 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257" returned: 0 in 0.537s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257, size 1024.00 MB, duration 4.11 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:55:41 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Converted 1024.00 MB image at 248.93 MB/s Jul 18 05:55:41 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 is being set with open permissions: ugo+rw Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:41 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 Jul 18 05:55:41 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:41 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1" returned: 0 in 0.230s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-cdeb2951-c569-45f1-aa04-9a82993b86c1" released by "_copy_volume_from_snapshot" :: held 5.675s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-8e3cc2ea-e140-4695-aab1-d26bb8999e22-cdeb2951-c569-45f1-aa04-9a82993b86c1" released by "_create_volume_from_snapshot" :: held 5.703s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.717s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a00af6-1d3f-4f23-b888-8fd91749cff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdeb2951-c569-45f1-aa04-9a82993b86c1', 'volume_size': 1, 'snapshot_id': '8e3cc2ea-e140-4695-aab1-d26bb8999e22'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4ab3f9-6c7c-4595-b3f4-c8a64f409143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:41 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Volume volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 (cdeb2951-c569-45f1-aa04-9a82993b86c1): created successfully Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4ab3f9-6c7c-4595-b3f4-c8a64f409143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Flow 'volume_create_manager' (f735ee0c-2eb0-43cd-9263-0506a283a27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:41 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a6dfa6c2-4d3e-4591-af07-9976b8bc2247 tempest-VolumeDependencyTests-1023270415 None] Created volume successfully. Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "cinder-8e3cc2ea-e140-4695-aab1-d26bb8999e22-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-8e3cc2ea-e140-4695-aab1-d26bb8999e22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "cinder-quobyte-f5039aac-5721-4011-8640-8b50815b9257" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-f5039aac-5721-4011-8640-8b50815b9257" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "cinder-quobyte-8e3cc2ea-e140-4695-aab1-d26bb8999e22" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-8e3cc2ea-e140-4695-aab1-d26bb8999e22" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Deleting offline snapshot 8e3cc2ea-e140-4695-aab1-d26bb8999e22 of volume f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] snapshot_file for this snap is: volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7103d-3f99-42aa-b5ba-b51313ac5898]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:42 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 Jul 18 05:55:42 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:42 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22" returned: 0 in 0.356s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5039aac-5721-4011-8640-8b50815b9257(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ef28b6-b237-47ba-9f1d-d612fee9f553]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:42 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 Jul 18 05:55:42 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:42 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257" returned: 0 in 0.358s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:42 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 Jul 18 05:55:42 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:43 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22" returned: 0 in 0.338s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:43 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22 Jul 18 05:55:43 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:43 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257.8e3cc2ea-e140-4695-aab1-d26bb8999e22" returned: 0 in 0.248s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-8e3cc2ea-e140-4695-aab1-d26bb8999e22" released by "_delete_snapshot" :: held 1.394s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-f5039aac-5721-4011-8640-8b50815b9257" released by "delete_snapshot" :: held 1.420s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:43 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Created reservations ['f9eaad76-dd2d-43d9-908d-b8fe4c19bba7', '0e42e15b-bb33-4840-b946-6137b4541b22', '579a4a93-01e7-4ffd-91e7-b93c957fbc70', 'bb8468a1-4de4-4cac-b788-60dc37e94f62'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Delete snapshot completed successfully. Jul 18 05:55:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c84accb2-5b7d-400a-8b6e-f91050ccb356 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-8e3cc2ea-e140-4695-aab1-d26bb8999e22-delete_snapshot" released by "delete_snapshot" :: held 1.551s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "cinder-f5039aac-5721-4011-8640-8b50815b9257-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-f5039aac-5721-4011-8640-8b50815b9257-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "cinder-quobyte-f5039aac-5721-4011-8640-8b50815b9257" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-f5039aac-5721-4011-8640-8b50815b9257" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32da6e4-8318-438e-bf4d-f00705c2de02]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:44 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 Jul 18 05:55:44 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:44 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257" returned: 0 in 0.345s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:44 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257 Jul 18 05:55:44 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:44 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f5039aac-5721-4011-8640-8b50815b9257" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-f5039aac-5721-4011-8640-8b50815b9257" released by "delete_volume" :: held 0.641s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Created reservations ['d8a6f9f1-ba31-45c1-bb21-4c3746b1f3bf', '9aabb27e-2a8d-4927-a1c6-cf864b082f24', '2a4b7912-0629-4486-be52-38278f5c470c', 'c605c803-fb66-40b6-ab49-45d5fee6bd7c'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:45 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:45 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:45 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.243s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:45 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Deleted volume successfully. Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cc0e2eb2-c483-45fb-bd18-b539635a2f05 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-f5039aac-5721-4011-8640-8b50815b9257-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "cinder-cdeb2951-c569-45f1-aa04-9a82993b86c1-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-cdeb2951-c569-45f1-aa04-9a82993b86c1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "cinder-quobyte-cdeb2951-c569-45f1-aa04-9a82993b86c1" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-cdeb2951-c569-45f1-aa04-9a82993b86c1" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6860686-5b8e-432b-8614-48a800f9bb29]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:45 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 Jul 18 05:55:45 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:45 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1" returned: 0 in 0.351s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:45 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1 Jul 18 05:55:45 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:46 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cdeb2951-c569-45f1-aa04-9a82993b86c1" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-quobyte-cdeb2951-c569-45f1-aa04-9a82993b86c1" released by "delete_volume" :: held 0.631s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Created reservations ['3ba8b199-fd8d-4d5f-bf99-94c0b80b1291', 'b18d364b-99b4-4326-9285-14a3e49c8979', '5d324444-fcda-4239-aff4-b880bca62e8f', 'd08e43d5-c1bc-46e6-9fdd-4e73a7508530'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:46 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:46 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:46 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.234s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Deleted volume successfully. Jul 18 05:55:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5acfef9f-b360-4c9c-8d61-0d804b2924b6 tempest-VolumeDependencyTests-1023270415 None] Lock "cinder-cdeb2951-c569-45f1-aa04-9a82993b86c1-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:53 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Flow 'volume_create_manager' (ebdfd743-19f2-4a1d-a32e-9ede2fffd0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ce0611-1392-4050-859b-b62853a040d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:53 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=92,cinder:UPDATE=121,cinder:INSERT=32,cinder:DELETE=9 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:55:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ce0611-1392-4050-859b-b62853a040d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288274526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eab22f1-1259-49b3-97d5-3cb76effefba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727ce8778d24522b4eb488303a73b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:54Z,use_quota=True,user_id='e3fd75a562f94727aadf7d8f8c64599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a5f022-c367-46f8-8ba3-26094fd0a738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a5f022-c367-46f8-8ba3-26094fd0a738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fe27d3-a7c5-4b22-ae2a-cd74aca16af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fe27d3-a7c5-4b22-ae2a-cd74aca16af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eab22f1-1259-49b3-97d5-3cb76effefba', 'volume_name': 'volume-9eab22f1-1259-49b3-97d5-3cb76effefba', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f64211-2a20-465a-b41d-1f0834290ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f64211-2a20-465a-b41d-1f0834290ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41099a09-52f4-49c2-ac63-4047dc692540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:54 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Volume 9eab22f1-1259-49b3-97d5-3cb76effefba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eab22f1-1259-49b3-97d5-3cb76effefba', 'volume_size': 1} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288274526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eab22f1-1259-49b3-97d5-3cb76effefba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727ce8778d24522b4eb488303a73b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:54Z,use_quota=True,user_id='e3fd75a562f94727aadf7d8f8c64599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Creating volume 9eab22f1-1259-49b3-97d5-3cb76effefba {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:54 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:54 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba 1073741824 Jul 18 05:55:54 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:54 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba 1073741824" returned: 0 in 0.397s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:54 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba Jul 18 05:55:54 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:54 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba" returned: 0 in 0.241s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41099a09-52f4-49c2-ac63-4047dc692540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eab22f1-1259-49b3-97d5-3cb76effefba', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4c10e4-c4b5-4078-bfb0-ebbc4de96fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:54 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Volume volume-9eab22f1-1259-49b3-97d5-3cb76effefba (9eab22f1-1259-49b3-97d5-3cb76effefba): created successfully Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4c10e4-c4b5-4078-bfb0-ebbc4de96fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Flow 'volume_create_manager' (ebdfd743-19f2-4a1d-a32e-9ede2fffd0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:54 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0e377bff-97cc-4ed8-88af-eb0d1170cebf tempest-ProjectReaderTests-1716332495 None] Created volume successfully. Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Acquiring lock "cinder-9eab22f1-1259-49b3-97d5-3cb76effefba-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Lock "cinder-9eab22f1-1259-49b3-97d5-3cb76effefba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Acquiring lock "cinder-quobyte-9eab22f1-1259-49b3-97d5-3cb76effefba" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Lock "cinder-quobyte-9eab22f1-1259-49b3-97d5-3cb76effefba" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa889edc-6d09-41d8-a9e0-860684250567]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:55 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba Jul 18 05:55:55 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:55 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba" returned: 0 in 0.354s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:55 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba Jul 18 05:55:55 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:55 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9eab22f1-1259-49b3-97d5-3cb76effefba" returned: 0 in 0.253s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Lock "cinder-quobyte-9eab22f1-1259-49b3-97d5-3cb76effefba" released by "delete_volume" :: held 0.645s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Created reservations ['34f0ca4d-84c5-4569-a808-dd747ca24299', 'd2cb7562-7058-4e83-8c90-7b06d0dde086', 'a3ac8b3c-867d-4485-9478-50e8f2db817d', 'd636cae0-5bca-45c4-9049-ca7c2df41b47'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:55 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:55 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:56 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.251s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Deleted volume successfully. Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fec0c39-8ffd-4391-af61-3817d63e1e1b tempest-ProjectReaderTests-1716332495 None] Lock "cinder-9eab22f1-1259-49b3-97d5-3cb76effefba-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Flow 'volume_create_manager' (585a2a80-01bd-4436-8875-31c04c248e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5eafee-72e6-4953-a72e-dc589bf8279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5eafee-72e6-4953-a72e-dc589bf8279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632798763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bed4f0c-2123-4e7b-890a-ce70d64517a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727ce8778d24522b4eb488303a73b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:57Z,use_quota=True,user_id='e3fd75a562f94727aadf7d8f8c64599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3738e3a1-9b49-4acd-8581-f81ca8836cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3738e3a1-9b49-4acd-8581-f81ca8836cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1a9f75-ed49-46d7-bf82-6bf63ec7e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1a9f75-ed49-46d7-bf82-6bf63ec7e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bed4f0c-2123-4e7b-890a-ce70d64517a1', 'volume_name': 'volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9ecc72-49ec-49a1-bde9-8ef95bc1a8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9ecc72-49ec-49a1-bde9-8ef95bc1a8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ddde76-1fe1-44d6-9973-afa9945bce33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:56 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Volume 9bed4f0c-2123-4e7b-890a-ce70d64517a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1', 'volume_size': 1} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632798763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bed4f0c-2123-4e7b-890a-ce70d64517a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727ce8778d24522b4eb488303a73b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:57Z,use_quota=True,user_id='e3fd75a562f94727aadf7d8f8c64599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Creating volume 9bed4f0c-2123-4e7b-890a-ce70d64517a1 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:56 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:56 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 1073741824 Jul 18 05:55:56 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:57 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 1073741824" returned: 0 in 0.395s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:57 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 Jul 18 05:55:57 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:57 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1" returned: 0 in 0.240s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ddde76-1fe1-44d6-9973-afa9945bce33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c649e1b-e26e-430a-b17b-7bf4d7667f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:57 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Volume volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 (9bed4f0c-2123-4e7b-890a-ce70d64517a1): created successfully Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c649e1b-e26e-430a-b17b-7bf4d7667f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Flow 'volume_create_manager' (585a2a80-01bd-4436-8875-31c04c248e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d7f78721-8e91-4e23-8d74-daf1d3658736 tempest-ProjectReaderTests-1716332495 None] Created volume successfully. Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Acquiring lock "cinder-9bed4f0c-2123-4e7b-890a-ce70d64517a1-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Lock "cinder-9bed4f0c-2123-4e7b-890a-ce70d64517a1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Acquiring lock "cinder-quobyte-9bed4f0c-2123-4e7b-890a-ce70d64517a1" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Lock "cinder-quobyte-9bed4f0c-2123-4e7b-890a-ce70d64517a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff45448b-3fd3-4480-bef5-d8ca65e60ea7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:55:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:57 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 Jul 18 05:55:57 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:58 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1" returned: 0 in 0.379s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:58 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1 Jul 18 05:55:58 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:58 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9bed4f0c-2123-4e7b-890a-ce70d64517a1" returned: 0 in 0.243s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Lock "cinder-quobyte-9bed4f0c-2123-4e7b-890a-ce70d64517a1" released by "delete_volume" :: held 0.658s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Created reservations ['497b7997-9a35-4cd9-a829-4e391439bac6', '16fa23e1-2886-4f42-8b1b-c1037fcd547d', 'b772f2b2-315d-40f2-8d92-de39ae6a64e2', '698e39cf-847c-4004-8dd9-682e6f82c507'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:58 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:55:58 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:58 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.248s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:58 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Deleted volume successfully. Jul 18 05:55:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4a939288-6b24-4673-b0ce-950ab7f7604e tempest-ProjectReaderTests-1716332495 None] Lock "cinder-9bed4f0c-2123-4e7b-890a-ce70d64517a1-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Flow 'volume_create_manager' (fb3c080f-359d-4ad6-aeee-cf474b0e607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3167944-c676-4d32-810a-78900a6a5633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3167944-c676-4d32-810a-78900a6a5633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1382287189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fff54ce-1a6b-4b56-8954-baec4f79b3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727ce8778d24522b4eb488303a73b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:59Z,use_quota=True,user_id='e3fd75a562f94727aadf7d8f8c64599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12cee38-4327-43c8-91bc-29720e1a8ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12cee38-4327-43c8-91bc-29720e1a8ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74aeb02a-2dad-412a-85b8-73be9fc3cabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74aeb02a-2dad-412a-85b8-73be9fc3cabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fff54ce-1a6b-4b56-8954-baec4f79b3b5', 'volume_name': 'volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c25c3e-510a-401a-91a8-48e4e93c03bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c25c3e-510a-401a-91a8-48e4e93c03bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de868d16-26bf-4b5b-8b2c-4f68e8b20488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:55:59 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Volume 6fff54ce-1a6b-4b56-8954-baec4f79b3b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5', 'volume_size': 1} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1382287189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fff54ce-1a6b-4b56-8954-baec4f79b3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727ce8778d24522b4eb488303a73b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:55:59Z,use_quota=True,user_id='e3fd75a562f94727aadf7d8f8c64599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Creating volume 6fff54ce-1a6b-4b56-8954-baec4f79b3b5 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:55:59 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:59 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 1073741824 Jul 18 05:55:59 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:59 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 1073741824" returned: 0 in 0.417s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:59 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 Jul 18 05:55:59 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:00 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5" returned: 0 in 0.239s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de868d16-26bf-4b5b-8b2c-4f68e8b20488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6144ba16-2efa-4b5d-8f95-f87058569565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:00 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Volume volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 (6fff54ce-1a6b-4b56-8954-baec4f79b3b5): created successfully Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6144ba16-2efa-4b5d-8f95-f87058569565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Flow 'volume_create_manager' (fb3c080f-359d-4ad6-aeee-cf474b0e607b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:00 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-28181eda-c158-4a53-82c4-78a182ac57fc tempest-ProjectReaderTests-1716332495 None] Created volume successfully. Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Acquiring lock "cinder-6fff54ce-1a6b-4b56-8954-baec4f79b3b5-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Lock "cinder-6fff54ce-1a6b-4b56-8954-baec4f79b3b5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Acquiring lock "cinder-quobyte-6fff54ce-1a6b-4b56-8954-baec4f79b3b5" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Lock "cinder-quobyte-6fff54ce-1a6b-4b56-8954-baec4f79b3b5" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa001a11-bfb8-4cc2-8609-66d16a486956]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:00 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 Jul 18 05:56:00 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:00 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5" returned: 0 in 0.344s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:00 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5 Jul 18 05:56:00 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:01 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6fff54ce-1a6b-4b56-8954-baec4f79b3b5" returned: 0 in 0.244s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Lock "cinder-quobyte-6fff54ce-1a6b-4b56-8954-baec4f79b3b5" released by "delete_volume" :: held 0.626s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Created reservations ['1c5859ab-9503-48fa-8f55-93b8cebd581a', '93749ba8-534b-4921-bf01-a849bc228d8d', 'b45b2db2-7dfb-42b4-ab5d-c50f60c8edc3', '6d567224-8a9e-4565-b080-386b0a3b1502'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:01 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:01 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:01 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:01 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Deleted volume successfully. Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-6fc2aab3-38a8-421d-8589-48542a0e3660 tempest-ProjectReaderTests-1716332495 None] Lock "cinder-6fff54ce-1a6b-4b56-8954-baec4f79b3b5-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Flow 'volume_create_manager' (8eca1772-90e5-468d-8cc2-928324451fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0027e016-d8d7-45cc-9808-21064c802f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0027e016-d8d7-45cc-9808-21064c802f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385365197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda018b7-815c-478d-b2b2-05a6df241f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727ce8778d24522b4eb488303a73b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:02Z,use_quota=True,user_id='e3fd75a562f94727aadf7d8f8c64599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b374a8cf-7ffb-4b92-849f-43d314a25508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b374a8cf-7ffb-4b92-849f-43d314a25508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:01 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc3f1f4-a93d-4fa2-bfe4-9d3dc4b57aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc3f1f4-a93d-4fa2-bfe4-9d3dc4b57aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda018b7-815c-478d-b2b2-05a6df241f18', 'volume_name': 'volume-dda018b7-815c-478d-b2b2-05a6df241f18', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817a193c-f42b-4485-95d3-03792bd67a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817a193c-f42b-4485-95d3-03792bd67a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bdd8ad-f8c4-4e61-bc2a-9451c5da6c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:02 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Volume dda018b7-815c-478d-b2b2-05a6df241f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda018b7-815c-478d-b2b2-05a6df241f18', 'volume_size': 1} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385365197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda018b7-815c-478d-b2b2-05a6df241f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7727ce8778d24522b4eb488303a73b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:02Z,use_quota=True,user_id='e3fd75a562f94727aadf7d8f8c64599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Creating volume dda018b7-815c-478d-b2b2-05a6df241f18 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:02 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:02 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18 1073741824 Jul 18 05:56:02 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:02 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18 1073741824" returned: 0 in 0.397s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:02 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18 Jul 18 05:56:02 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:02 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18" returned: 0 in 0.240s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bdd8ad-f8c4-4e61-bc2a-9451c5da6c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda018b7-815c-478d-b2b2-05a6df241f18', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe507d22-387d-4cd2-8c48-00a4ac89cc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:02 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Volume volume-dda018b7-815c-478d-b2b2-05a6df241f18 (dda018b7-815c-478d-b2b2-05a6df241f18): created successfully Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe507d22-387d-4cd2-8c48-00a4ac89cc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Flow 'volume_create_manager' (8eca1772-90e5-468d-8cc2-928324451fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:02 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7e18162f-7fa4-4a90-9c4d-43b4e0499fae tempest-ProjectReaderTests-1716332495 None] Created volume successfully. Jul 18 05:56:02 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Acquiring lock "cinder-dda018b7-815c-478d-b2b2-05a6df241f18-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Lock "cinder-dda018b7-815c-478d-b2b2-05a6df241f18-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Acquiring lock "cinder-quobyte-dda018b7-815c-478d-b2b2-05a6df241f18" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Lock "cinder-quobyte-dda018b7-815c-478d-b2b2-05a6df241f18" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be198e3-a195-4dfc-86a0-0a5f90802d2c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:03 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18 Jul 18 05:56:03 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:03 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18" returned: 0 in 0.346s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:03 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18 Jul 18 05:56:03 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:03 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dda018b7-815c-478d-b2b2-05a6df241f18" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Lock "cinder-quobyte-dda018b7-815c-478d-b2b2-05a6df241f18" released by "delete_volume" :: held 0.625s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Created reservations ['1a9686c6-507f-4918-b976-3970b4f1a69b', 'bb582506-36d1-446a-a4fc-f68fa07a4266', 'fa471af2-0ae5-4741-b812-7095b5434590', '231dcfb5-10d9-48c9-8f3b-d184ebed255c'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:03 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:03 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:04 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.234s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:04 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:04 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Deleted volume successfully. Jul 18 05:56:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-bfd65aa5-0755-48ef-bf24-63ef9eebb0e9 tempest-ProjectReaderTests-1716332495 None] Lock "cinder-dda018b7-815c-478d-b2b2-05a6df241f18-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:06 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:06 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:06 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.238s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:56:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:56:13 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=95,cinder:UPDATE=132,cinder:DELETE=11,cinder:INSERT=26 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:56:14 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:UPDATE=45,cinder:SELECT=27,cinder:INSERT=14,cinder:DELETE=7 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (7166814f-0943-4a56-9257-54fc46280cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145a6c0a-6918-4c52-af55-1287efa83bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145a6c0a-6918-4c52-af55-1287efa83bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1466696695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d726c5d-634f-4a09-974d-6c4ec33c3cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:16Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3bbe075-5dbb-4668-8265-676ae9cac9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3bbe075-5dbb-4668-8265-676ae9cac9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c43a04-49c8-4320-839e-cc8d926429f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c43a04-49c8-4320-839e-cc8d926429f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d726c5d-634f-4a09-974d-6c4ec33c3cc1', 'volume_name': 'volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633d6af6-ad00-4d93-ab3c-d22f9f97240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633d6af6-ad00-4d93-ab3c-d22f9f97240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d169f9c-b961-4702-9da8-017e78e9fcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Volume 2d726c5d-634f-4a09-974d-6c4ec33c3cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1', 'volume_size': 1} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1466696695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d726c5d-634f-4a09-974d-6c4ec33c3cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:16Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Creating volume 2d726c5d-634f-4a09-974d-6c4ec33c3cc1 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:15 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:16 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 1073741824 Jul 18 05:56:16 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (019f58e1-87a3-47b5-994c-baef163d1833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4385c56f-fc2f-4aea-9342-c76fcde1d4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4385c56f-fc2f-4aea-9342-c76fcde1d4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800582882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c9d77f-49fa-43e5-9d2e-777c630ef0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:16Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31def902-3511-42b8-b756-95913fa1efb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31def902-3511-42b8-b756-95913fa1efb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa611a46-4276-49e8-b022-d5dfae29f120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa611a46-4276-49e8-b022-d5dfae29f120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c9d77f-49fa-43e5-9d2e-777c630ef0cb', 'volume_name': 'volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85dd0b40-6c7d-4bfb-9523-b675239c3dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85dd0b40-6c7d-4bfb-9523-b675239c3dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ced516b-4074-49dd-9198-b888cefb79da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume 09c9d77f-49fa-43e5-9d2e-777c630ef0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb', 'volume_size': 1} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (1acd47ae-7d4b-49d7-ba0b-d29b65efb50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f1ad3-7760-4cb7-ba8c-c0c890c3198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f1ad3-7760-4cb7-ba8c-c0c890c3198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868598023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c28125-86fb-489b-b264-5c84cee7beba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:16Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baef5608-d10f-49b3-b7d4-e339f8c66ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baef5608-d10f-49b3-b7d4-e339f8c66ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bf71e4-6774-49bd-9239-3cb2ca75c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bf71e4-6774-49bd-9239-3cb2ca75c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c28125-86fb-489b-b264-5c84cee7beba', 'volume_name': 'volume-29c28125-86fb-489b-b264-5c84cee7beba', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2027258-82c0-403e-8d48-9d914dd23795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2027258-82c0-403e-8d48-9d914dd23795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8736e688-954a-4712-9891-1de915003543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Volume 29c28125-86fb-489b-b264-5c84cee7beba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c28125-86fb-489b-b264-5c84cee7beba', 'volume_size': 1} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:16 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 1073741824" returned: 0 in 0.684s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:16 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 Jul 18 05:56:16 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (457ab153-a44d-4b9b-a3bb-f599baf8535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f4bb02-3c50-4ca4-a5dd-67f3e08d4c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f4bb02-3c50-4ca4-a5dd-67f3e08d4c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1940212177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090b6791-720f-46e2-a847-1123d444cda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:17Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d977c2-44f3-4a8d-add6-55ce7b70eb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d977c2-44f3-4a8d-add6-55ce7b70eb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c67be56-1370-441c-a935-891135cf0ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c67be56-1370-441c-a935-891135cf0ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090b6791-720f-46e2-a847-1123d444cda6', 'volume_name': 'volume-090b6791-720f-46e2-a847-1123d444cda6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d1eff2-75e3-4c51-8067-29b98b0d8e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d1eff2-75e3-4c51-8067-29b98b0d8e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e59b30-04ef-46b3-9267-5f94a6e2a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume 090b6791-720f-46e2-a847-1123d444cda6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090b6791-720f-46e2-a847-1123d444cda6', 'volume_size': 1} Jul 18 05:56:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:17 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1" returned: 0 in 0.388s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800582882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c9d77f-49fa-43e5-9d2e-777c630ef0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:16Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Creating volume 09c9d77f-49fa-43e5-9d2e-777c630ef0cb {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:17 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:17 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb 1073741824 Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (d88fad45-28a1-453f-b7a8-31384cffdbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:17 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176473dc-02d2-4f63-9074-ffc54925fb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d169f9c-b961-4702-9da8-017e78e9fcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387ef0fd-1465-4eaa-bfca-dafa2a141e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176473dc-02d2-4f63-9074-ffc54925fb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-655147646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b164d32-90f8-4a2b-9eb4-fe59c27c036c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:17Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40acbbf9-3819-4a56-ac32-858ca0dd9326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40acbbf9-3819-4a56-ac32-858ca0dd9326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce8adba-7e3a-4409-944b-e6238e4ad4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce8adba-7e3a-4409-944b-e6238e4ad4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b164d32-90f8-4a2b-9eb4-fe59c27c036c', 'volume_name': 'volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8414e20d-037f-4de9-9df5-a35110b5eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8414e20d-037f-4de9-9df5-a35110b5eedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c7c96e-7df4-4f92-9eb5-8718fc21ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Volume 7b164d32-90f8-4a2b-9eb4-fe59c27c036c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c', 'volume_size': 1} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Volume volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 (2d726c5d-634f-4a09-974d-6c4ec33c3cc1): created successfully Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387ef0fd-1465-4eaa-bfca-dafa2a141e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (7166814f-0943-4a56-9257-54fc46280cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (0f9e437d-e1a0-41f2-bf7b-0334e413b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e56217-b30b-49a3-aad9-78acd3942f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e56217-b30b-49a3-aad9-78acd3942f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1792837791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ee3542-5913-46ba-a65b-3d328233b08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:17Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bc799c-69fb-46a6-b95a-81feb7f7cd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bc799c-69fb-46a6-b95a-81feb7f7cd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ae7866-4c12-429f-8f89-ced734813419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ae7866-4c12-429f-8f89-ced734813419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ee3542-5913-46ba-a65b-3d328233b08c', 'volume_name': 'volume-29ee3542-5913-46ba-a65b-3d328233b08c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b41272-5542-4e32-b872-2cdce076b972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b41272-5542-4e32-b872-2cdce076b972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6216e0a7-2a57-42c3-b0bc-1e9f9334c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Volume 29ee3542-5913-46ba-a65b-3d328233b08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ee3542-5913-46ba-a65b-3d328233b08c', 'volume_size': 1} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:17 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-bb93dcfa-503b-46ff-ab7d-efb9580470e1 tempest-CreateVolumesFromImageTest-1821482492 None] Created volume successfully. Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (dbe734b0-4e43-4e14-be2d-1f612aec9417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5f2cc6-18c5-4967-8dc2-45ca31339fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5f2cc6-18c5-4967-8dc2-45ca31339fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1544432845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4cacc8-2dec-4631-ad0c-bba0b40d6f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:17Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1e24a8-5edf-4f9b-b015-5426b3ad4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1e24a8-5edf-4f9b-b015-5426b3ad4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f8ce11-c2e7-4913-b0c0-b5c0c86c2275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f8ce11-c2e7-4913-b0c0-b5c0c86c2275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e4cacc8-2dec-4631-ad0c-bba0b40d6f47', 'volume_name': 'volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83395f6a-4e8a-4b96-b16a-1128fb959c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83395f6a-4e8a-4b96-b16a-1128fb959c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e569af-59e0-4a8b-affe-96953a399f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Volume 8e4cacc8-2dec-4631-ad0c-bba0b40d6f47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47', 'volume_size': 1} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:17 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb 1073741824" returned: 0 in 0.646s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:17 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb Jul 18 05:56:17 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:18 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" returned: 0 in 0.255s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868598023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c28125-86fb-489b-b264-5c84cee7beba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:16Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Creating volume 29c28125-86fb-489b-b264-5c84cee7beba {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:18 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ced516b-4074-49dd-9198-b888cefb79da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec976c26-6d80-46c1-8950-20a1a4e0347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:18 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba 1073741824 Jul 18 05:56:18 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb (09c9d77f-49fa-43e5-9d2e-777c630ef0cb): created successfully Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec976c26-6d80-46c1-8950-20a1a4e0347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (019f58e1-87a3-47b5-994c-baef163d1833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-3ae90382-3baf-4661-b2b4-af3b71f6fd3f tempest-CreateVolumesFromSnapshotTest-18739002 None] Created volume successfully. Jul 18 05:56:18 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba 1073741824" returned: 0 in 0.498s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:18 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba Jul 18 05:56:18 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:18 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba" returned: 0 in 0.246s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.976s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1940212177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090b6791-720f-46e2-a847-1123d444cda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:17Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Creating volume 090b6791-720f-46e2-a847-1123d444cda6 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:18 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8736e688-954a-4712-9891-1de915003543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c28125-86fb-489b-b264-5c84cee7beba', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:18 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6 1073741824 Jul 18 05:56:18 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b7fc84-24dc-4622-ba46-1efd5d7b707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:18 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Volume volume-29c28125-86fb-489b-b264-5c84cee7beba (29c28125-86fb-489b-b264-5c84cee7beba): created successfully Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b7fc84-24dc-4622-ba46-1efd5d7b707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:18 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (1acd47ae-7d4b-49d7-ba0b-d29b65efb50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-40a430ca-02f9-4e48-bf96-9e3893ece939 tempest-CreateVolumesFromImageTest-1821482492 None] Created volume successfully. Jul 18 05:56:19 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6 1073741824" returned: 0 in 0.559s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:19 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6 Jul 18 05:56:19 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:19 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6" returned: 0 in 0.261s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.456s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-655147646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b164d32-90f8-4a2b-9eb4-fe59c27c036c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:17Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Creating volume 7b164d32-90f8-4a2b-9eb4-fe59c27c036c {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:19 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e59b30-04ef-46b3-9267-5f94a6e2a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090b6791-720f-46e2-a847-1123d444cda6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:19 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c 1073741824 Jul 18 05:56:19 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3258a2-0e9f-4478-b57b-e6cf3e5db09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:19 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume volume-090b6791-720f-46e2-a847-1123d444cda6 (090b6791-720f-46e2-a847-1123d444cda6): created successfully Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3258a2-0e9f-4478-b57b-e6cf3e5db09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (457ab153-a44d-4b9b-a3bb-f599baf8535c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:19 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5e277c7d-4e34-4f1a-9744-38a498de458c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created volume successfully. Jul 18 05:56:20 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c 1073741824" returned: 0 in 0.490s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Flow 'volume_create_manager' (5724e2ae-7778-4f08-baac-1f27b9f3af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca0155a-8efd-4e8c-8886-85268c0d3a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca0155a-8efd-4e8c-8886-85268c0d3a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3b8b8e-a994-4c5e-b30a-41d391332925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add4f389a9fb450bb4e3a0ca4ff892ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:20Z,use_quota=True,user_id='5be56fac69c74bb499984189f23cb8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9fc38af-45b6-4dfe-9a16-6560597f7464),volume_type_id=d9fc38af-45b6-4dfe-9a16-6560597f7464)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d635f892-ce1c-4cfa-9f60-fd736018b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:20 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c Jul 18 05:56:20 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d635f892-ce1c-4cfa-9f60-fd736018b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac5e94d-bd98-494c-aa37-480f5172d624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.image.glance [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Creating Keystone auth plugin from conf {{(pid=87497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 05:56:20 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c" returned: 0 in 0.275s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.134s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1792837791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ee3542-5913-46ba-a65b-3d328233b08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:17Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Creating volume 29ee3542-5913-46ba-a65b-3d328233b08c {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:20 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c7c96e-7df4-4f92-9eb5-8718fc21ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a15a1ef-625e-44d3-93ca-de1fb3be227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:20 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c 1073741824 Jul 18 05:56:20 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:20 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Volume volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c (7b164d32-90f8-4a2b-9eb4-fe59c27c036c): created successfully Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a15a1ef-625e-44d3-93ca-de1fb3be227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (d88fad45-28a1-453f-b7a8-31384cffdbd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b00decc0-f82f-4d5a-9929-c0c29ba03482 tempest-CreateVolumesFromImageTest-1821482492 None] Created volume successfully. Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac5e94d-bd98-494c-aa37-480f5172d624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'df3b8b8e-a994-4c5e-b30a-41d391332925', 'volume_name': 'volume-df3b8b8e-a994-4c5e-b30a-41d391332925', 'volume_size': 1, 'image_id': 'a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7df1c5eb982648f7bc42d2198ffe5fa5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'add4f389a9fb450bb4e3a0ca4ff892ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da7e34f5a4f44d7334e840175958c2ccb5e5a6a48f3d6b931a735a2a59c81f23cedc660ab339d19cb6e89aea8bb565c861084c9b2af9e795c466abb22ea35555', 'id': 'a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'created_at': datetime.datetime(2026, 7, 18, 3, 56, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 56, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0b95d5d-c617-4489-b8dc-5c4a6ff070bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c81934-2d75-4547-98c7-25f579079bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c81934-2d75-4547-98c7-25f579079bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3f59bd-42af-4cf3-8feb-f7b9899b9596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:20 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Volume df3b8b8e-a994-4c5e-b30a-41d391332925: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-df3b8b8e-a994-4c5e-b30a-41d391332925', 'volume_size': 1, 'image_id': 'a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7df1c5eb982648f7bc42d2198ffe5fa5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'add4f389a9fb450bb4e3a0ca4ff892ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da7e34f5a4f44d7334e840175958c2ccb5e5a6a48f3d6b931a735a2a59c81f23cedc660ab339d19cb6e89aea8bb565c861084c9b2af9e795c466abb22ea35555', 'id': 'a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'created_at': datetime.datetime(2026, 7, 18, 3, 56, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 56, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0b95d5d-c617-4489-b8dc-5c4a6ff070bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Trying to clone df3b8b8e-a994-4c5e-b30a-41d391332925 from image a0b95d5d-c617-4489-b8dc-5c4a6ff070bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'metadata': {}}]). {{(pid=87497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 05:56:20 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Image download 0.00 MB at 0.00 MB/s Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a0281-e544-4b05-8756-0abd15154c8f]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:21 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD Jul 18 05:56:21 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (1bb0e32a-9194-415d-a0c7-c1ee6eb5140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0e6982-3595-4b23-8a71-0c70b26a1fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0e6982-3595-4b23-8a71-0c70b26a1fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1144790813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdbf1c9-f18b-487d-8b69-ee6991954196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:21Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54bce8f-c75d-49da-a40e-b009516040c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54bce8f-c75d-49da-a40e-b009516040c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fa4706-4aa1-4e41-a93b-2ec11eca2787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fa4706-4aa1-4e41-a93b-2ec11eca2787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbdbf1c9-f18b-487d-8b69-ee6991954196', 'volume_name': 'volume-fbdbf1c9-f18b-487d-8b69-ee6991954196', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18346648-11d9-47cc-8342-0bcac04d6ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18346648-11d9-47cc-8342-0bcac04d6ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22307984-7738-409f-863e-f3d5d1046aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume fbdbf1c9-f18b-487d-8b69-ee6991954196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbdbf1c9-f18b-487d-8b69-ee6991954196', 'volume_size': 1} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:21 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c 1073741824" returned: 0 in 0.630s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:21 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c Jul 18 05:56:21 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:21 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:21 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD Jul 18 05:56:21 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (6ced3555-8a69-403e-af9a-86ae4d0cc424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1354d51-b39c-4f71-bd80-c27344c709b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1354d51-b39c-4f71-bd80-c27344c709b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-653835597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a030e37-278b-41d5-8e8a-e8931a4190f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:21Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7273774-3ee6-424e-b2d9-038d8b3ac398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7273774-3ee6-424e-b2d9-038d8b3ac398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0884f1e-a383-4d84-ab1f-78a811e5b108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0884f1e-a383-4d84-ab1f-78a811e5b108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a030e37-278b-41d5-8e8a-e8931a4190f2', 'volume_name': 'volume-8a030e37-278b-41d5-8e8a-e8931a4190f2', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ca26d6-f229-4090-89de-5e67923f99eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ca26d6-f229-4090-89de-5e67923f99eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741a0371-0c48-4603-9924-6519465c3efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume 8a030e37-278b-41d5-8e8a-e8931a4190f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a030e37-278b-41d5-8e8a-e8931a4190f2', 'volume_size': 1} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:21 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c" returned: 0 in 0.363s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.094s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1544432845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4cacc8-2dec-4631-ad0c-bba0b40d6f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a9c52dd0354e718b0cf89aba3912bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:17Z,use_quota=True,user_id='418010e0862f4bcaa6ae10b78b1fae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Creating volume 8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:21 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6216e0a7-2a57-42c3-b0bc-1e9f9334c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ee3542-5913-46ba-a65b-3d328233b08c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b13e06-3a44-425d-8cab-e8ddc7a96a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:21 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 1073741824 Jul 18 05:56:21 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Volume volume-29ee3542-5913-46ba-a65b-3d328233b08c (29ee3542-5913-46ba-a65b-3d328233b08c): created successfully Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b13e06-3a44-425d-8cab-e8ddc7a96a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (0f9e437d-e1a0-41f2-bf7b-0334e413b520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a062ec86-257f-49ee-8df8-70d73b69d48d tempest-CreateVolumesFromImageTest-1821482492 None] Created volume successfully. Jul 18 05:56:21 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD" returned: 1 in 0.536s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Temporary image a0b95d5d-c617-4489-b8dc-5c4a6ff070bd is fetched for user 5be56fac69c74bb499984189f23cb8d5. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 05:56:21 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (bb5e6c50-ab08-423d-9ad6-c142c9f153b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd15d5e8-651e-425e-868c-6ca0eed67e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd15d5e8-651e-425e-868c-6ca0eed67e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781762455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc99e6c3-3b50-451c-b894-8ac3aadf2d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:22Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4750e226-6bb1-4cf0-a902-0cc89f4804c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4750e226-6bb1-4cf0-a902-0cc89f4804c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7270ac-d685-4c38-9e08-4450218db0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7270ac-d685-4c38-9e08-4450218db0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc99e6c3-3b50-451c-b894-8ac3aadf2d37', 'volume_name': 'volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf1bdbf-67f2-49c6-965f-4c45a41b9fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf1bdbf-67f2-49c6-965f-4c45a41b9fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1bef5d-8acd-4e6c-aabb-42f0d9d30ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume cc99e6c3-3b50-451c-b894-8ac3aadf2d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37', 'volume_size': 1} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1b8c6e-1ba7-4e74-8af6-7c34e2705d4c]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:22 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD Jul 18 05:56:22 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:22 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 1073741824" returned: 0 in 0.637s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:22 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 Jul 18 05:56:22 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (2a8f04c5-3035-4b1a-9fad-1a2cca52ae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d8de8c-7321-4254-aa27-c0bce3f027c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d8de8c-7321-4254-aa27-c0bce3f027c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827011753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99333b6f-e32c-47f6-9018-236c27108ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:22Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88191f5-cb07-4f22-a2af-c066ba445fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88191f5-cb07-4f22-a2af-c066ba445fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a16f6b-9825-447e-a486-d9f1706b1eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a16f6b-9825-447e-a486-d9f1706b1eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99333b6f-e32c-47f6-9018-236c27108ae6', 'volume_name': 'volume-99333b6f-e32c-47f6-9018-236c27108ae6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837d733c-f23c-4079-ba2f-0dca535fdd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837d733c-f23c-4079-ba2f-0dca535fdd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e30a5c-8e42-40d5-a453-4de7f424d951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume 99333b6f-e32c-47f6-9018-236c27108ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99333b6f-e32c-47f6-9018-236c27108ae6', 'volume_size': 1} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:22 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:22 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47" returned: 0 in 0.318s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.242s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:22 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD Jul 18 05:56:22 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Creating offline snapshot f38dde43-741b-47ec-9ba6-a274a073fb10 of volume 09c9d77f-49fa-43e5-9d2e-777c630ef0cb {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e569af-59e0-4a8b-affe-96953a399f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c065a0-bf3c-40ee-917e-6995a594fdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e00a2-1c2f-49d5-b60b-5636d142c50c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:22 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Volume volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 (8e4cacc8-2dec-4631-ad0c-bba0b40d6f47): created successfully Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c065a0-bf3c-40ee-917e-6995a594fdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Flow 'volume_create_manager' (dbe734b0-4e43-4e14-be2d-1f612aec9417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-02497ebb-6944-458c-934a-7817010d6785 tempest-CreateVolumesFromImageTest-1821482492 None] Created volume successfully. Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (8ccc4a15-9590-4391-84b7-c9d4bb4b1451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68543d8c-d61d-49e2-9e4f-ed161b07e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68543d8c-d61d-49e2-9e4f-ed161b07e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558473569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e07098e-ba26-49e0-a0e3-70c73fa397dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:23Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076a7f13-a81a-4f47-b009-a7b5ebd79fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076a7f13-a81a-4f47-b009-a7b5ebd79fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb Jul 18 05:56:22 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed140064-aa9e-40ca-a5ed-a1732444cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed140064-aa9e-40ca-a5ed-a1732444cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e07098e-ba26-49e0-a0e3-70c73fa397dd', 'volume_name': 'volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd79696-f549-449c-8321-0f9ac6b56a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd79696-f549-449c-8321-0f9ac6b56a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14eeb97-b85c-443e-8ff4-d1666418647e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:22 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume 2e07098e-ba26-49e0-a0e3-70c73fa397dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd', 'volume_size': 1} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:22 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:56:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:23 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" returned: 0 in 0.404s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:23 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 1G Jul 18 05:56:23 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-quobyte-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47" acquired by "delete_volume" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce9b6f0-3174-4892-a459-1185fe55a19b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:23 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 Jul 18 05:56:23 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:23 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 1G" returned: 0 in 0.425s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:23 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 Jul 18 05:56:23 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:23 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47" returned: 0 in 0.402s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:23 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47 Jul 18 05:56:23 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:23 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10" returned: 0 in 0.304s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:23 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 is being set with open permissions: ugo+rw Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:23 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 Jul 18 05:56:23 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:23 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47" returned: 0 in 0.262s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47" released by "delete_volume" :: held 0.704s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:23 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Created reservations ['5cdad864-c0ed-4d6a-9252-2d1768379f59', '36fd0722-3911-4c26-9b1a-e9102952ef0e', '227c69bd-cec0-445a-b4ea-af5357f8ccae', '9f0bac98-92aa-4ebc-8286-c0727542aa9a'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:24 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:24 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:24 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10" returned: 0 in 0.254s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:24 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.info Jul 18 05:56:24 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:24 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.286s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-29ee3542-5913-46ba-a65b-3d328233b08c-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:24 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Deleted volume successfully. Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-29ee3542-5913-46ba-a65b-3d328233b08c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c492070-def7-4216-9af1-e3c23dc9a8a3 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-8e4cacc8-2dec-4631-ad0c-bba0b40d6f47-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-quobyte-29ee3542-5913-46ba-a65b-3d328233b08c" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-29ee3542-5913-46ba-a65b-3d328233b08c" acquired by "delete_volume" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c142a4c-d0f6-43d4-8aa1-64dd95937ed6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:24 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.info" returned: 0 in 0.318s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:24 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.info is being set with open permissions: ugo+rw Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:24 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.info Jul 18 05:56:24 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:24 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c Jul 18 05:56:24 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:24 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.info" returned: 0 in 0.249s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.526s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1144790813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdbf1c9-f18b-487d-8b69-ee6991954196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:21Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Creating volume fbdbf1c9-f18b-487d-8b69-ee6991954196 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:24 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:24 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 1073741824 Jul 18 05:56:24 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:24 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4b76b5f5-206c-4ef8-bc90-c2d12a598ddf tempest-CreateVolumesFromSnapshotTest-18739002 None] Create snapshot completed successfully Jul 18 05:56:24 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c" returned: 0 in 0.393s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:24 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c Jul 18 05:56:24 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:25 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29ee3542-5913-46ba-a65b-3d328233b08c" returned: 0 in 0.257s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-29ee3542-5913-46ba-a65b-3d328233b08c" released by "delete_volume" :: held 0.699s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Created reservations ['b0e2d83c-749c-434b-aeda-150b73a41229', 'd1c10d34-927c-4047-9254-6cead3a154de', '867a6b3d-4027-4a4d-8016-340d77912b06', 'f65ffc04-650c-4d44-a943-06bcab3659f4'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:25 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 1073741824" returned: 0 in 0.437s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:25 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 Jul 18 05:56:25 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:25 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:25 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:25 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196" returned: 0 in 0.264s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.894s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-653835597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a030e37-278b-41d5-8e8a-e8931a4190f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:21Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Creating volume 8a030e37-278b-41d5-8e8a-e8931a4190f2 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:25 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:25 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-7b164d32-90f8-4a2b-9eb4-fe59c27c036c-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:25 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 1073741824 Jul 18 05:56:25 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.293s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22307984-7738-409f-863e-f3d5d1046aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbdbf1c9-f18b-487d-8b69-ee6991954196', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04f847e-43c7-4489-9f0d-6a52aea82e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:25 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Deleted volume successfully. Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-7b164d32-90f8-4a2b-9eb4-fe59c27c036c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:25 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 (fbdbf1c9-f18b-487d-8b69-ee6991954196): created successfully Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04f847e-43c7-4489-9f0d-6a52aea82e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (1bb0e32a-9194-415d-a0c7-c1ee6eb5140d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-5fa3cb84-6996-4bf8-a262-d63614159f69 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-29ee3542-5913-46ba-a65b-3d328233b08c-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:25 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-833d0be4-0ca1-46d5-bb14-91aeb91a63a1 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created volume successfully. Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-quobyte-7b164d32-90f8-4a2b-9eb4-fe59c27c036c" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-7b164d32-90f8-4a2b-9eb4-fe59c27c036c" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[482dfd59-3746-49dd-a3e1-78362a2c91ad]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:25 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c Jul 18 05:56:25 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:26 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 1073741824" returned: 0 in 0.546s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:26 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 Jul 18 05:56:26 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:26 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c" returned: 0 in 0.470s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:26 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c Jul 18 05:56:26 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (c8bc7ec7-d01f-4f15-b757-0b0a9ad38b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4acadfb-a165-4aec-a50d-f26d05e2de3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4acadfb-a165-4aec-a50d-f26d05e2de3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558221234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca523901-685d-4026-abc0-56aff39b9d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:26Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c420aa48-84bc-4c3b-8bea-47054bd91dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c420aa48-84bc-4c3b-8bea-47054bd91dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000063b3-1db9-43a6-9818-df1669543348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000063b3-1db9-43a6-9818-df1669543348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca523901-685d-4026-abc0-56aff39b9d40', 'volume_name': 'volume-ca523901-685d-4026-abc0-56aff39b9d40', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5333517e-2edc-4abe-8981-dd535e61bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5333517e-2edc-4abe-8981-dd535e61bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc68a43-2e7e-4dec-bceb-d18301218ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume ca523901-685d-4026-abc0-56aff39b9d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca523901-685d-4026-abc0-56aff39b9d40', 'volume_size': 1} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:26 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2" returned: 0 in 0.298s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.344s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781762455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc99e6c3-3b50-451c-b894-8ac3aadf2d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:22Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Creating volume cc99e6c3-3b50-451c-b894-8ac3aadf2d37 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:26 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741a0371-0c48-4603-9924-6519465c3efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a030e37-278b-41d5-8e8a-e8931a4190f2', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e8bc9d-e6ef-4d4a-b46d-8ebfd54c8bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 1073741824 Jul 18 05:56:26 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:26 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 (8a030e37-278b-41d5-8e8a-e8931a4190f2): created successfully Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e8bc9d-e6ef-4d4a-b46d-8ebfd54c8bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (6ced3555-8a69-403e-af9a-86ae4d0cc424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7b164d32-90f8-4a2b-9eb4-fe59c27c036c" returned: 0 in 0.341s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-7b164d32-90f8-4a2b-9eb4-fe59c27c036c" released by "delete_volume" :: held 0.894s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-caf9066b-f227-440a-869f-6bff0095db7b tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created volume successfully. Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Created reservations ['79774c25-7d5c-4f84-a993-c02c310344aa', '61953051-b1fc-402f-a15f-be6e8b6c7e15', '94853996-39ac-43df-9732-57c62860c7a9', '5f6495ed-5450-40fb-a5be-647dc10259df'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (7e4c98f7-5125-4fc6-9438-0f5f05b1e1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92968206-291f-4e2d-b244-aa348a2df3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92968206-291f-4e2d-b244-aa348a2df3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955566066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae79980-6f33-4324-b1c5-c913e87bd0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:27Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f247600-bfe9-4e02-ab5b-d081ecee781a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f247600-bfe9-4e02-ab5b-d081ecee781a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff27ba69-6572-4bf3-9ba4-c06beaed3297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff27ba69-6572-4bf3-9ba4-c06beaed3297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae79980-6f33-4324-b1c5-c913e87bd0b2', 'volume_name': 'volume-cae79980-6f33-4324-b1c5-c913e87bd0b2', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56750022-47b0-4e52-a6eb-ecb3234bdd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56750022-47b0-4e52-a6eb-ecb3234bdd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4348a2ed-af55-486e-8ae8-48594e611f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:26 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume cae79980-6f33-4324-b1c5-c913e87bd0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae79980-6f33-4324-b1c5-c913e87bd0b2', 'volume_size': 1} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:26 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:26 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:27 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 1073741824" returned: 0 in 0.617s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:27 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 Jul 18 05:56:27 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:27 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (a03eafb2-21ca-48fb-abfd-27c4b06e613f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff0077a-ad33-469e-8327-2b6257b7ec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.320s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:27 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Deleted volume successfully. Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff0077a-ad33-469e-8327-2b6257b7ec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1119263682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82054637-f256-4735-be8c-013613cf2660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:27Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f731e2-823e-46e5-a1c3-774988f78e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f731e2-823e-46e5-a1c3-774988f78e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb2bd14-8587-43af-8ced-61226f11e8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb2bd14-8587-43af-8ced-61226f11e8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82054637-f256-4735-be8c-013613cf2660', 'volume_name': 'volume-82054637-f256-4735-be8c-013613cf2660', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982b14e4-f9b8-41db-9654-3378a756d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982b14e4-f9b8-41db-9654-3378a756d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f042d8-37b6-4583-8204-91c8c1cb3a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume 82054637-f256-4735-be8c-013613cf2660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82054637-f256-4735-be8c-013613cf2660', 'volume_size': 1} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-936755cc-ff45-4a51-8b9b-afd0a91b8ac9 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-7b164d32-90f8-4a2b-9eb4-fe59c27c036c-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:27 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37" returned: 0 in 0.278s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.897s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827011753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99333b6f-e32c-47f6-9018-236c27108ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:22Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Creating volume 99333b6f-e32c-47f6-9018-236c27108ae6 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:27 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1bef5d-8acd-4e6c-aabb-42f0d9d30ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6 1073741824 Jul 18 05:56:27 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618afa80-6446-421d-8b15-738273cfb1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 (cc99e6c3-3b50-451c-b894-8ac3aadf2d37): created successfully Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618afa80-6446-421d-8b15-738273cfb1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (bb5e6c50-ab08-423d-9ad6-c142c9f153b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:27 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-659147f4-444c-4683-acb8-611a72603800 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created volume successfully. Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (aede14cc-4a38-403c-bd23-7dcff58856bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c269172e-80e5-4c6e-aa4d-22f18d9eedff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c269172e-80e5-4c6e-aa4d-22f18d9eedff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058070239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d704f4e-0ea8-4f70-89c0-613aabfb2fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:28Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d71c665-d445-4ffe-bb34-cb8f6ca16a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d71c665-d445-4ffe-bb34-cb8f6ca16a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbc172c-64f8-4af5-87c4-45f946a9086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbc172c-64f8-4af5-87c4-45f946a9086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d704f4e-0ea8-4f70-89c0-613aabfb2fce', 'volume_name': 'volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbca477-242f-4bb7-92de-b50e6129408d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbca477-242f-4bb7-92de-b50e6129408d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49f42a6-75e5-4cf9-a0c6-a3dd67b644ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:27 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume 9d704f4e-0ea8-4f70-89c0-613aabfb2fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce', 'volume_size': 1} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-29c28125-86fb-489b-b264-5c84cee7beba-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-29c28125-86fb-489b-b264-5c84cee7beba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-quobyte-29c28125-86fb-489b-b264-5c84cee7beba" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-29c28125-86fb-489b-b264-5c84cee7beba" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e5a5b6-86f0-45cd-be19-a13f6ca8aa34]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:28 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6 1073741824" returned: 0 in 0.602s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:28 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6 Jul 18 05:56:28 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:28 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba Jul 18 05:56:28 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (7a2c495f-a7a4-4456-8bc2-a72629f46c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df38aa6-9e42-4636-b5cc-2de38d57a9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df38aa6-9e42-4636-b5cc-2de38d57a9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-907049336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d8d312-1472-4db1-a2e7-0f4daf001c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:28Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30356356-9ac7-4e65-8e86-ee07bb32bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30356356-9ac7-4e65-8e86-ee07bb32bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184af983-358a-4a46-a5d5-f26f8312e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184af983-358a-4a46-a5d5-f26f8312e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d8d312-1472-4db1-a2e7-0f4daf001c67', 'volume_name': 'volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51128de-9452-4c40-acbd-cb1634e30f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51128de-9452-4c40-acbd-cb1634e30f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24524cb2-ab84-4663-a98c-7ae068e12f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:28 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume b8d8d312-1472-4db1-a2e7-0f4daf001c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67', 'volume_size': 1} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:28 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6" returned: 0 in 0.251s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.435s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558473569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e07098e-ba26-49e0-a0e3-70c73fa397dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db935173484b7e8ac3468a859b4b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:23Z,use_quota=True,user_id='3ad47d26ed8f4a61abefc8508a116059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Creating volume 2e07098e-ba26-49e0-a0e3-70c73fa397dd {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:28 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e30a5c-8e42-40d5-a453-4de7f424d951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99333b6f-e32c-47f6-9018-236c27108ae6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:28 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd 1073741824 Jul 18 05:56:28 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11f65fa-667f-4ebf-8f12-584cd00914e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:28 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume volume-99333b6f-e32c-47f6-9018-236c27108ae6 (99333b6f-e32c-47f6-9018-236c27108ae6): created successfully Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11f65fa-667f-4ebf-8f12-584cd00914e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (2a8f04c5-3035-4b1a-9fad-1a2cca52ae23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:28 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6f7a62fa-0c35-4560-ad74-3a520b9de992 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created volume successfully. Jul 18 05:56:28 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba" returned: 0 in 0.421s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:28 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba Jul 18 05:56:28 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:28 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-29c28125-86fb-489b-b264-5c84cee7beba" returned: 0 in 0.275s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-29c28125-86fb-489b-b264-5c84cee7beba" released by "delete_volume" :: held 0.746s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Created reservations ['7f466ac1-a48a-406c-8d28-ac511e685621', '79d47b5b-9c1c-47bd-b815-bdbae91a6898', 'd9635485-16c0-4813-a38a-efc5b074af29', '4117c7b3-d6af-40d7-8394-8ab3577095ba'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:28 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd 1073741824" returned: 0 in 0.471s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:28 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:28 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:28 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd Jul 18 05:56:28 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:29 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-2d726c5d-634f-4a09-974d-6c4ec33c3cc1-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.269s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:29 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Deleted volume successfully. Jul 18 05:56:29 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-2d726c5d-634f-4a09-974d-6c4ec33c3cc1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd" returned: 0 in 0.283s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.187s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3b8b8e-a994-4c5e-b30a-41d391332925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add4f389a9fb450bb4e3a0ca4ff892ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:20Z,use_quota=True,user_id='5be56fac69c74bb499984189f23cb8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9fc38af-45b6-4dfe-9a16-6560597f7464),volume_type_id=d9fc38af-45b6-4dfe-9a16-6560597f7464)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Creating volume df3b8b8e-a994-4c5e-b30a-41d391332925 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:29 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33a8f82a-b906-471b-a17e-cc45ae2c14ef tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-29c28125-86fb-489b-b264-5c84cee7beba-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:29 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 1073741824 Jul 18 05:56:29 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14eeb97-b85c-443e-8ff4-d1666418647e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d92a7f-5f62-462d-9ccb-6ee0221426b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:29 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Volume volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd (2e07098e-ba26-49e0-a0e3-70c73fa397dd): created successfully Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d92a7f-5f62-462d-9ccb-6ee0221426b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Flow 'volume_create_manager' (8ccc4a15-9590-4391-84b7-c9d4bb4b1451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "cinder-quobyte-2d726c5d-634f-4a09-974d-6c4ec33c3cc1" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:29 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e37eaf1e-33d4-4ceb-b9ef-9736adf67e96 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created volume successfully. Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-2d726c5d-634f-4a09-974d-6c4ec33c3cc1" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c86e40-5a41-493a-9827-94dc05a4263b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:29 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 Jul 18 05:56:29 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-2e07098e-ba26-49e0-a0e3-70c73fa397dd-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-2e07098e-ba26-49e0-a0e3-70c73fa397dd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-quobyte-2e07098e-ba26-49e0-a0e3-70c73fa397dd" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-2e07098e-ba26-49e0-a0e3-70c73fa397dd" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5509dd68-c243-4a84-9c51-a54442b4313b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:29 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 1073741824" returned: 0 in 0.533s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:29 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1" returned: 0 in 0.414s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:29 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1 Jul 18 05:56:29 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:29 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd Jul 18 05:56:29 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:29 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 Jul 18 05:56:29 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:29 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2d726c5d-634f-4a09-974d-6c4ec33c3cc1" returned: 0 in 0.263s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:29 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-quobyte-2d726c5d-634f-4a09-974d-6c4ec33c3cc1" released by "delete_volume" :: held 0.722s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:30 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925" returned: 0 in 0.275s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:30 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.645s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558221234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca523901-685d-4026-abc0-56aff39b9d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:26Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Creating volume ca523901-685d-4026-abc0-56aff39b9d40 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:30 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd" returned: 0 in 0.459s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:30 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40 1073741824 Jul 18 05:56:30 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:30 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd Jul 18 05:56:30 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Created reservations ['b0e5db6a-76c0-4887-ac56-ae069d1002ad', '4a024e9b-ae61-4ae0-af0c-cd5876efba0b', 'c42dd443-ba5c-4381-b97d-573dd58a1c55', '3e0ddf8d-42a1-40d1-875c-6e874b2c75ee'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Attempting download of a0b95d5d-c617-4489-b8dc-5c4a6ff070bd ((None, [{'url': 'file:///opt/stack/data/glance/images/a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'metadata': {}}])) to volume df3b8b8e-a994-4c5e-b30a-41d391332925. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7960597-d930-4844-af55-681a429ee710]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_dea8dwws {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:30 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:30 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:30 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_dea8dwws Jul 18 05:56:30 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:30 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-2e07098e-ba26-49e0-a0e3-70c73fa397dd" returned: 0 in 0.446s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-2e07098e-ba26-49e0-a0e3-70c73fa397dd" released by "delete_volume" :: held 0.962s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created reservations ['e8f4d878-64c1-4fbe-a7bb-dc9e0ab7acdf', '8b355fd6-b420-4112-b7d9-a9ec79a30608', '52521fa7-197f-4631-9c45-7bd3a8a07689', '238b63ea-4202-4769-a9b0-aced05de164e'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:30 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.439s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Deleted volume successfully. Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e9031942-a464-46cf-81ac-d87e48e01e51 tempest-CreateVolumesFromImageTest-1821482492 None] Lock "cinder-2d726c5d-634f-4a09-974d-6c4ec33c3cc1-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:30 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_dea8dwws" returned: 0 in 0.495s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_dea8dwws {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:30 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:30 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:30 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40 1073741824" returned: 0 in 0.755s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:30 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40 Jul 18 05:56:30 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:30 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_dea8dwws Jul 18 05:56:30 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:31 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.326s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Deleted volume successfully. Jul 18 05:56:31 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ddbf6d83-fe90-4f2e-ada2-708e0600dbfd tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-2e07098e-ba26-49e0-a0e3-70c73fa397dd-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_dea8dwws" returned: 1 in 0.362s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_dea8dwws' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d1c1cb-5b8e-483b-93ca-e2eb07d2c1d4]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:31 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40" returned: 0 in 0.332s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.334s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955566066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae79980-6f33-4324-b1c5-c913e87bd0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:27Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Creating volume cae79980-6f33-4324-b1c5-c913e87bd0b2 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:31 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc68a43-2e7e-4dec-bceb-d18301218ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca523901-685d-4026-abc0-56aff39b9d40', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535caba0-e223-4d11-bcc0-89fa8ef3052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:31 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 1073741824 Jul 18 05:56:31 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume volume-ca523901-685d-4026-abc0-56aff39b9d40 (ca523901-685d-4026-abc0-56aff39b9d40): created successfully Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535caba0-e223-4d11-bcc0-89fa8ef3052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (c8bc7ec7-d01f-4f15-b757-0b0a9ad38b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2bdeca8a-792a-4e8a-9be5-22419b7e6083 tempest-CreateVolumesFromSnapshotTest-18739002 None] Created volume successfully. Jul 18 05:56:31 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD Jul 18 05:56:31 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:31 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:31 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD Jul 18 05:56:31 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:31 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 1073741824" returned: 0 in 0.580s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-99333b6f-e32c-47f6-9018-236c27108ae6-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-99333b6f-e32c-47f6-9018-236c27108ae6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:31 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 Jul 18 05:56:31 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-quobyte-99333b6f-e32c-47f6-9018-236c27108ae6" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-99333b6f-e32c-47f6-9018-236c27108ae6" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3910a75-8e9c-40b2-83b8-70f47b6d1695]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:31 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] a0b95d5d-c617-4489-b8dc-5c4a6ff070bd was raw, converting to qcow2 {{(pid=87497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:32 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 Jul 18 05:56:32 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:32 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6 Jul 18 05:56:32 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:32 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2" returned: 0 in 0.336s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.906s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1119263682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82054637-f256-4735-be8c-013613cf2660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:27Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Creating volume 82054637-f256-4735-be8c-013613cf2660 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:32 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4348a2ed-af55-486e-8ae8-48594e611f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae79980-6f33-4324-b1c5-c913e87bd0b2', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd82028b-4957-478b-ae3f-dc3a5e37b4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:32 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660 1073741824 Jul 18 05:56:32 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 (cae79980-6f33-4324-b1c5-c913e87bd0b2): created successfully Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd82028b-4957-478b-ae3f-dc3a5e37b4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (7e4c98f7-5125-4fc6-9438-0f5f05b1e1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-be32cb42-20ed-45c7-b790-f55d2f5f6e63 tempest-CreateVolumesFromSnapshotTest-18739002 None] Created volume successfully. Jul 18 05:56:32 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6" returned: 0 in 0.561s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:32 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6 Jul 18 05:56:32 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:32 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925" returned: 0 in 0.632s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a0b95d5d-c617-4489-b8dc-5c4a6ff070bd_72ouu149devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:56:32 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Converted 0.00 MB image at 0.00 MB/s Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:32 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 1G Jul 18 05:56:32 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:32 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660 1073741824" returned: 0 in 0.544s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:32 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-99333b6f-e32c-47f6-9018-236c27108ae6" returned: 0 in 0.309s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:32 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660 Jul 18 05:56:32 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-99333b6f-e32c-47f6-9018-236c27108ae6" released by "delete_volume" :: held 0.939s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:32 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created reservations ['f913158b-5a67-4dc5-9d5f-4d6ff3968962', 'c12a1cff-29b8-4a9f-94df-2518055a65fd', 'e7baaf10-80ed-42fd-8c43-8893627cc4f2', 'd13ebcb5-cae2-4e5c-9a19-5489c47fcfdf'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:33 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 1G" returned: 0 in 0.392s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Downloaded image a0b95d5d-c617-4489-b8dc-5c4a6ff070bd ((None, [{'url': 'file:///opt/stack/data/glance/images/a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'metadata': {}}])) to volume df3b8b8e-a994-4c5e-b30a-41d391332925 successfully. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Temporary image a0b95d5d-c617-4489-b8dc-5c4a6ff070bd for user 5be56fac69c74bb499984189f23cb8d5 is deleted. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Marking volume df3b8b8e-a994-4c5e-b30a-41d391332925 as bootable. {{(pid=87497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Copying metadata from image a0b95d5d-c617-4489-b8dc-5c4a6ff070bd to df3b8b8e-a994-4c5e-b30a-41d391332925. {{(pid=87497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Creating volume glance metadata for volume df3b8b8e-a994-4c5e-b30a-41d391332925 backed by image a0b95d5d-c617-4489-b8dc-5c4a6ff070bd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7df1c5eb982648f7bc42d2198ffe5fa5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:33 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:33 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:33 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660" returned: 0 in 0.319s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.420s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058070239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d704f4e-0ea8-4f70-89c0-613aabfb2fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:28Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Creating volume 9d704f4e-0ea8-4f70-89c0-613aabfb2fce {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:33 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f042d8-37b6-4583-8204-91c8c1cb3a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82054637-f256-4735-be8c-013613cf2660', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:33 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce 1073741824 Jul 18 05:56:33 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ceca5d-9a62-4a35-86a3-b04d7d51204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:33 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume volume-82054637-f256-4735-be8c-013613cf2660 (82054637-f256-4735-be8c-013613cf2660): created successfully Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ceca5d-9a62-4a35-86a3-b04d7d51204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (a03eafb2-21ca-48fb-abfd-27c4b06e613f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3f59bd-42af-4cf3-8feb-f7b9899b9596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3b8b8e-a994-4c5e-b30a-41d391332925', 'volume_size': 1, 'image_id': 'a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7df1c5eb982648f7bc42d2198ffe5fa5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'add4f389a9fb450bb4e3a0ca4ff892ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da7e34f5a4f44d7334e840175958c2ccb5e5a6a48f3d6b931a735a2a59c81f23cedc660ab339d19cb6e89aea8bb565c861084c9b2af9e795c466abb22ea35555', 'id': 'a0b95d5d-c617-4489-b8dc-5c4a6ff070bd', 'created_at': datetime.datetime(2026, 7, 18, 3, 56, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 56, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0b95d5d-c617-4489-b8dc-5c4a6ff070bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efa65f8-9b10-41d8-be65-de6428431ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0bf44bc3-9332-45cd-b195-19ca5e46d8cb tempest-CreateVolumesFromSnapshotTest-18739002 None] Created volume successfully. Jul 18 05:56:33 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Volume volume-df3b8b8e-a994-4c5e-b30a-41d391332925 (df3b8b8e-a994-4c5e-b30a-41d391332925): created successfully Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efa65f8-9b10-41d8-be65-de6428431ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Flow 'volume_create_manager' (5724e2ae-7778-4f08-baac-1f27b9f3af6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-22bd88ca-da97-4d98-9c17-837d6ff04355 tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Created volume successfully. Jul 18 05:56:33 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.325s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Deleted volume successfully. Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d5ffac38-7517-446f-9fda-c2ffefc8223d tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-99333b6f-e32c-47f6-9018-236c27108ae6-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:33 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce 1073741824" returned: 0 in 0.601s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:33 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce Jul 18 05:56:33 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:34 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce" returned: 0 in 0.278s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.881s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-907049336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d8d312-1472-4db1-a2e7-0f4daf001c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126a080045184afa894dae62ce2f61f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:28Z,use_quota=True,user_id='c19b0e2faab2418287a8c447915d7af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Creating volume b8d8d312-1472-4db1-a2e7-0f4daf001c67 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:34 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49f42a6-75e5-4cf9-a0c6-a3dd67b644ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49754d9-9647-485a-a7c4-993625a9fd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:34 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 1073741824 Jul 18 05:56:34 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-cc99e6c3-3b50-451c-b894-8ac3aadf2d37-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:34 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce (9d704f4e-0ea8-4f70-89c0-613aabfb2fce): created successfully Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49754d9-9647-485a-a7c4-993625a9fd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (aede14cc-4a38-403c-bd23-7dcff58856bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-cc99e6c3-3b50-451c-b894-8ac3aadf2d37-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:34 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-64b2cdd4-c8bb-4442-8470-807bfa9f6378 tempest-CreateVolumesFromSnapshotTest-18739002 None] Created volume successfully. Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Flow 'volume_create_manager' (293e6d0d-11d4-499e-9936-6184ba2625bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db2f2a8-fcc8-46fd-aecd-83350efc909d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db2f2a8-fcc8-46fd-aecd-83350efc909d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-234162339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5076fcf-2b2a-45aa-8482-a67151693adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ccb8ad4a5a4c19b8adf5a607fc00e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:34Z,use_quota=True,user_id='3682895cb01f462b94888c0c2de02f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cbf01d-0fdf-486d-8983-8e3420c00943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cbf01d-0fdf-486d-8983-8e3420c00943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5033f2bf-9b96-4c40-9e88-0702a57a5014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5033f2bf-9b96-4c40-9e88-0702a57a5014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5076fcf-2b2a-45aa-8482-a67151693adb', 'volume_name': 'volume-d5076fcf-2b2a-45aa-8482-a67151693adb', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411e8c98-f234-49b6-a89d-4d8613438363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411e8c98-f234-49b6-a89d-4d8613438363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dad018-f07c-4694-be18-a2de65cc0112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:34 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Volume d5076fcf-2b2a-45aa-8482-a67151693adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5076fcf-2b2a-45aa-8482-a67151693adb', 'volume_size': 1} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-quobyte-cc99e6c3-3b50-451c-b894-8ac3aadf2d37" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-cc99e6c3-3b50-451c-b894-8ac3aadf2d37" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Acquiring lock "cinder-df3b8b8e-a994-4c5e-b30a-41d391332925-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b28ec65-b7bc-4f31-b7e9-825937fcb645]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "cinder-df3b8b8e-a994-4c5e-b30a-41d391332925-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Acquiring lock "cinder-quobyte-df3b8b8e-a994-4c5e-b30a-41d391332925" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "cinder-quobyte-df3b8b8e-a994-4c5e-b30a-41d391332925" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cec7bac-0f9c-417b-b46a-07dd77e5369c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:34 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 Jul 18 05:56:34 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:34 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 1073741824" returned: 0 in 0.530s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:34 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 Jul 18 05:56:34 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:34 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 Jul 18 05:56:34 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:34 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37" returned: 0 in 0.430s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:34 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37 Jul 18 05:56:34 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:34 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:34 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67" returned: 0 in 0.282s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-234162339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5076fcf-2b2a-45aa-8482-a67151693adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ccb8ad4a5a4c19b8adf5a607fc00e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:34Z,use_quota=True,user_id='3682895cb01f462b94888c0c2de02f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Creating volume d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:34 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925" returned: 0 in 0.473s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:35 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb 1073741824 Jul 18 05:56:35 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24524cb2-ab84-4663-a98c-7ae068e12f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:35 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925 Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a618997f-2d0b-45b5-8e7a-28315678270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:35 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:35 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Volume volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 (b8d8d312-1472-4db1-a2e7-0f4daf001c67): created successfully Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a618997f-2d0b-45b5-8e7a-28315678270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Flow 'volume_create_manager' (7a2c495f-a7a4-4456-8bc2-a72629f46c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-09d72cd7-4468-435d-bb23-2fdfad1bf3a8 tempest-CreateVolumesFromSnapshotTest-18739002 None] Created volume successfully. Jul 18 05:56:35 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cc99e6c3-3b50-451c-b894-8ac3aadf2d37" returned: 0 in 0.343s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-cc99e6c3-3b50-451c-b894-8ac3aadf2d37" released by "delete_volume" :: held 0.827s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created reservations ['e1fa3d48-281a-413f-94ba-0700b8ec11eb', '91dc714a-62b0-4dbd-bc20-668dfc2f1f6e', '09ea8b77-d219-48de-bb38-8de0d9edd5cb', '84cb1b9c-11fe-4c39-a5a6-9eb5818e9fa2'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:35 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-df3b8b8e-a994-4c5e-b30a-41d391332925" returned: 0 in 0.367s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "cinder-quobyte-df3b8b8e-a994-4c5e-b30a-41d391332925" released by "delete_volume" :: held 0.886s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:35 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:35 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Created reservations ['1a7bdedf-3b9f-4830-a8ab-2477627ea7d8', 'dcfe9241-0ca5-4d7f-82df-d6a8aa39414a', '8dcf3888-e954-49de-a86f-137beefc4680', '4cffd142-4be7-4418-bb9e-a226cad3b0e8'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:35 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb 1073741824" returned: 0 in 0.607s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:35 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:35 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:35 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.308s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Deleted volume successfully. Jul 18 05:56:35 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-22b676cd-c941-4f93-bfc8-c4553f232b28 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-cc99e6c3-3b50-451c-b894-8ac3aadf2d37-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:35 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:35 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.323s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Deleted volume successfully. Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d74c49a8-60e0-4e57-ab76-b1a03e0e1fcb tempest-VolumeAndVolumeTypeFromImageTest-1344045971 None] Lock "cinder-df3b8b8e-a994-4c5e-b30a-41d391332925-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-b8d8d312-1472-4db1-a2e7-0f4daf001c67-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-b8d8d312-1472-4db1-a2e7-0f4daf001c67-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:36 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb" returned: 0 in 0.368s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dad018-f07c-4694-be18-a2de65cc0112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5076fcf-2b2a-45aa-8482-a67151693adb', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178b3e58-a34b-4319-b6f1-f83bf39261d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:36 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Volume volume-d5076fcf-2b2a-45aa-8482-a67151693adb (d5076fcf-2b2a-45aa-8482-a67151693adb): created successfully Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178b3e58-a34b-4319-b6f1-f83bf39261d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Flow 'volume_create_manager' (293e6d0d-11d4-499e-9936-6184ba2625bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-quobyte-b8d8d312-1472-4db1-a2e7-0f4daf001c67" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:36 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-60f668c0-d1b0-4c8b-a654-800ada56526c tempest-VolumeDependencyTests-1909271829 None] Created volume successfully. Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-b8d8d312-1472-4db1-a2e7-0f4daf001c67" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[27826537-3093-4419-9ba8-537768d30685]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:36 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 Jul 18 05:56:36 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-8a030e37-278b-41d5-8e8a-e8931a4190f2-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-8a030e37-278b-41d5-8e8a-e8931a4190f2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:36 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67" returned: 0 in 0.455s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-quobyte-8a030e37-278b-41d5-8e8a-e8931a4190f2" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:36 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67 Jul 18 05:56:36 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Creating offline snapshot 67848fc0-e766-410d-8430-98064ba03a10 of volume d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-8a030e37-278b-41d5-8e8a-e8931a4190f2" acquired by "delete_volume" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[108d1e15-db39-4a33-96a5-9e0c47b3e121]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5d04ef-b34c-4a35-9ca7-bf2adbfcb917]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:36 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb Jul 18 05:56:36 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:36 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 Jul 18 05:56:36 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:36 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b8d8d312-1472-4db1-a2e7-0f4daf001c67" returned: 0 in 0.279s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-b8d8d312-1472-4db1-a2e7-0f4daf001c67" released by "delete_volume" :: held 0.780s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:36 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Created reservations ['a0a403bd-6dce-4c39-974e-6a5d60bb25d1', '0bdd5fbd-584e-4dab-b63f-658620a6b56f', 'e9f19f0d-9f0a-46cf-b795-e583e3eceae4', '256328a0-d6e9-46b2-8842-3c8da92f4ae1'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:37 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb" returned: 0 in 0.422s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:37 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:37 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:37 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 1G Jul 18 05:56:37 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-9d704f4e-0ea8-4f70-89c0-613aabfb2fce-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-9d704f4e-0ea8-4f70-89c0-613aabfb2fce-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:37 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2" returned: 0 in 0.595s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:37 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2 Jul 18 05:56:37 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-quobyte-9d704f4e-0ea8-4f70-89c0-613aabfb2fce" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-9d704f4e-0ea8-4f70-89c0-613aabfb2fce" acquired by "delete_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5d7a52-8649-4ec4-affa-bb02650af252]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:37 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.457s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Deleted volume successfully. Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-84915c7d-1865-4c27-a798-49d9ca7e1c50 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-b8d8d312-1472-4db1-a2e7-0f4daf001c67-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:37 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce Jul 18 05:56:37 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:37 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8a030e37-278b-41d5-8e8a-e8931a4190f2" returned: 0 in 0.369s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-8a030e37-278b-41d5-8e8a-e8931a4190f2" released by "delete_volume" :: held 1.023s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:37 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 1G" returned: 0 in 0.633s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5076fcf-2b2a-45aa-8482-a67151693adb -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created reservations ['0336046f-f04e-484a-9e08-555d350c0f03', '80ce44d4-9a30-41b6-9cfa-b33974445ab7', 'd99af13d-93ef-4153-9f30-51c036f256a2', '123a57c8-0a96-485c-9d68-57e95b67e497'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:37 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5076fcf-2b2a-45aa-8482-a67151693adb -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 Jul 18 05:56:37 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:37 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:37 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:37 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce" returned: 0 in 0.537s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:37 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce Jul 18 05:56:37 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:38 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.312s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:38 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Deleted volume successfully. Jul 18 05:56:38 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5076fcf-2b2a-45aa-8482-a67151693adb -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10" returned: 0 in 0.440s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:38 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 is being set with open permissions: ugo+rw Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3e909413-1b8c-4e52-85d7-3ab501bd834c tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-8a030e37-278b-41d5-8e8a-e8931a4190f2-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:38 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 Jul 18 05:56:38 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:38 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9d704f4e-0ea8-4f70-89c0-613aabfb2fce" returned: 0 in 0.318s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-9d704f4e-0ea8-4f70-89c0-613aabfb2fce" released by "delete_volume" :: held 0.923s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Created reservations ['991c9f0f-b628-4850-8e64-8fbea32a40c5', 'f4ad7f6b-de97-4917-a004-02a4e2c35ffc', '426644c6-a6af-4217-b874-784b116af67e', '527c82d2-25ae-44c6-990c-a5e714548fb3'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:38 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10" returned: 0 in 0.299s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:38 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:38 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:38 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.info Jul 18 05:56:38 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-fbdbf1c9-f18b-487d-8b69-ee6991954196-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:38 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.288s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:38 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Deleted volume successfully. Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-fbdbf1c9-f18b-487d-8b69-ee6991954196-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-e42efbf5-2575-485f-9491-4851f3a8a794 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-9d704f4e-0ea8-4f70-89c0-613aabfb2fce-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:38 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.info" returned: 0 in 0.348s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-quobyte-fbdbf1c9-f18b-487d-8b69-ee6991954196" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:38 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.info is being set with open permissions: ugo+rw Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-fbdbf1c9-f18b-487d-8b69-ee6991954196" acquired by "delete_volume" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:38 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.info Jul 18 05:56:38 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d55d6aa-f052-4672-b0ae-2391bfa32152]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:39 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 Jul 18 05:56:39 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:39 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.info" returned: 0 in 0.324s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-fbe6b9ea-3c80-4474-bdb5-81eb8345572f tempest-VolumeDependencyTests-1909271829 None] Create snapshot completed successfully Jul 18 05:56:39 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196" returned: 0 in 0.412s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:39 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196 Jul 18 05:56:39 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-82054637-f256-4735-be8c-013613cf2660-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-82054637-f256-4735-be8c-013613cf2660-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-quobyte-82054637-f256-4735-be8c-013613cf2660" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-82054637-f256-4735-be8c-013613cf2660" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fad8a8-dafa-4f34-8414-d92e42b4aaf7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:39 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-fbdbf1c9-f18b-487d-8b69-ee6991954196" returned: 0 in 0.308s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-fbdbf1c9-f18b-487d-8b69-ee6991954196" released by "delete_volume" :: held 0.802s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:39 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660 Jul 18 05:56:39 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created reservations ['bd3577cb-eb93-4f53-9cfb-1ab6d2533cae', '5c89558b-c732-4ab6-82d0-66273ee97626', '1d0b1fb7-eaca-4a11-a911-83d3a688bb7b', 'f6134289-3174-4521-ada8-09a705bcccde'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:39 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:39 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-090b6791-720f-46e2-a847-1123d444cda6-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-090b6791-720f-46e2-a847-1123d444cda6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "cinder-quobyte-090b6791-720f-46e2-a847-1123d444cda6" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-090b6791-720f-46e2-a847-1123d444cda6" acquired by "delete_volume" :: waited 0.034s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:40 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660" returned: 0 in 0.594s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefc9e1a-3ca9-4f6c-9c00-675aa12f5588]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:40 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660 Jul 18 05:56:40 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:40 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.364s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Deleted volume successfully. Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-20354729-0ef2-442f-87a7-82d6d3208182 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-fbdbf1c9-f18b-487d-8b69-ee6991954196-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:40 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6 Jul 18 05:56:40 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:40 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-82054637-f256-4735-be8c-013613cf2660" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-82054637-f256-4735-be8c-013613cf2660" released by "delete_volume" :: held 0.942s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Flow 'volume_create_manager' (76fefd7c-0012-4424-8241-9ef54f55fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e8a9b2-233a-4968-a2ca-e60d5c52b1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e8a9b2-233a-4968-a2ca-e60d5c52b1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1076677327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f94c106-b9c4-4d9f-b7b8-a67086c099e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ccb8ad4a5a4c19b8adf5a607fc00e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67848fc0-e766-410d-8430-98064ba03a10,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:56:40Z,use_quota=True,user_id='3682895cb01f462b94888c0c2de02f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8dfb9e-c0d2-4c55-946e-5d77a0367d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8dfb9e-c0d2-4c55-946e-5d77a0367d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e87185e-6102-444a-9186-6d0ef180b225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e87185e-6102-444a-9186-6d0ef180b225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f94c106-b9c4-4d9f-b7b8-a67086c099e5', 'volume_name': 'volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5', 'volume_size': 1, 'snapshot_id': '67848fc0-e766-410d-8430-98064ba03a10'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2f77c1-4de6-4ef1-a7cd-c2d55b68645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2f77c1-4de6-4ef1-a7cd-c2d55b68645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8f0ec4-cb96-4ae2-bf85-1566e75705f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:40 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Volume 1f94c106-b9c4-4d9f-b7b8-a67086c099e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5', 'volume_size': 1, 'snapshot_id': '67848fc0-e766-410d-8430-98064ba03a10'} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "cinder-quobyte-67848fc0-e766-410d-8430-98064ba03a10-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" by "_create_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-67848fc0-e766-410d-8430-98064ba03a10-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Creating volume 1f94c106-b9c4-4d9f-b7b8-a67086c099e5 from snapshot 67848fc0-e766-410d-8430-98064ba03a10 {{(pid=87497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "cinder-quobyte-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Created reservations ['9bcc13b5-803c-409e-b3f6-7dcda3a7f0fc', 'fbc86591-755e-46b9-8d70-ddaaffb2b1ac', 'b19dda80-1842-4873-a5d3-3d2664f39ce3', '5d88b755-09c2-43c9-91d2-0bda56b11832'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] snapshot: 67848fc0-e766-410d-8430-98064ba03a10, volume: 1f94c106-b9c4-4d9f-b7b8-a67086c099e5, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:56:40 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6" returned: 0 in 0.530s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef592da-5566-4549-b4ac-39c16630f830]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:40 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6 Jul 18 05:56:40 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:40 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:40 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:40 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 Jul 18 05:56:40 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:41 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-090b6791-720f-46e2-a847-1123d444cda6" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-quobyte-090b6791-720f-46e2-a847-1123d444cda6" released by "delete_volume" :: held 0.909s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Created reservations ['ac74761d-2807-4ef4-936e-9dfb2e20f11e', 'c0ac0ab3-a552-4596-886f-511fa20467d1', '17cf51bf-0948-42d7-aca9-1f9f2e317cbf', 'f24aee75-3e8a-4965-9c09-64967014f8e5'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:41 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.320s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:41 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Deleted volume successfully. Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-79f5b24b-916b-44d9-9741-59907991ca41 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-82054637-f256-4735-be8c-013613cf2660-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:41 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10" returned: 0 in 0.477s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5076fcf-2b2a-45aa-8482-a67151693adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:56:41 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:41 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5fae0a-0f5e-4f17-ac59-b1f2bb342a01]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:41 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb Jul 18 05:56:41 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:41 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.274s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:41 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Deleted volume successfully. Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-76817e36-ae2e-4bd5-b7e7-5cf458ccd070 tempest-CreateVolumesFromSourceVolumeTest-1199277977 None] Lock "cinder-090b6791-720f-46e2-a847-1123d444cda6-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:41 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-27da118f-7987-4f79-85c3-e4729acb932a tempest-ProjectAdminTests-1712495291 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87497) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb" returned: 0 in 0.415s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:41 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 Jul 18 05:56:41 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-cae79980-6f33-4324-b1c5-c913e87bd0b2-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-cae79980-6f33-4324-b1c5-c913e87bd0b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-quobyte-cae79980-6f33-4324-b1c5-c913e87bd0b2" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-cae79980-6f33-4324-b1c5-c913e87bd0b2" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fd90da-9722-4e28-b211-afa3298fa118]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:42 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 Jul 18 05:56:42 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:42 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2" returned: 0 in 0.641s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:42 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2 Jul 18 05:56:42 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:43 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-cae79980-6f33-4324-b1c5-c913e87bd0b2" returned: 0 in 0.631s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-cae79980-6f33-4324-b1c5-c913e87bd0b2" released by "delete_volume" :: held 1.342s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:43 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Created reservations ['e9dbab13-3d23-4251-a1fe-bae96c94e8cb', '307d8256-1761-4b42-a5a1-ae97fd790ea2', '9a580880-4c7b-4543-9a5a-51319e8ebe4d', 'e60db2ab-234d-4710-8b37-cb10ad5297df'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:43 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:43 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-ca523901-685d-4026-abc0-56aff39b9d40-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-ca523901-685d-4026-abc0-56aff39b9d40-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:44 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.671s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:44 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:44 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Deleted volume successfully. Jul 18 05:56:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-quobyte-ca523901-685d-4026-abc0-56aff39b9d40" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-ca523901-685d-4026-abc0-56aff39b9d40" acquired by "delete_volume" :: waited 0.054s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dea5e06a-9515-435c-84bd-831266b5afa4 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-cae79980-6f33-4324-b1c5-c913e87bd0b2-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f713d2f5-3cd6-4fed-a804-289ea93d3c7e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:44 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40 Jul 18 05:56:44 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:45 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40" returned: 0 in 1.025s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:45 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40 Jul 18 05:56:45 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:46 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ca523901-685d-4026-abc0-56aff39b9d40" returned: 0 in 0.714s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-ca523901-685d-4026-abc0-56aff39b9d40" released by "delete_volume" :: held 1.881s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Created reservations ['9ca5a889-78b7-4268-bb51-0bc3ffc01dda', '59e0d3ae-e9e1-45e9-a6ed-94f83c833159', '98870798-7c4e-422d-9217-0d5af57f4e49', '6e9019ab-f3dc-455d-81f0-f69aabbaca00'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:46 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:46 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-f38dde43-741b-47ec-9ba6-a274a073fb10-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-f38dde43-741b-47ec-9ba6-a274a073fb10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-quobyte-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-quobyte-f38dde43-741b-47ec-9ba6-a274a073fb10" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-f38dde43-741b-47ec-9ba6-a274a073fb10" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Deleting offline snapshot f38dde43-741b-47ec-9ba6-a274a073fb10 of volume 09c9d77f-49fa-43e5-9d2e-777c630ef0cb {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] snapshot_file for this snap is: volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[74629914-0cea-496f-a0de-fa674bcafe60]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:47 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.652s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:47 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 Jul 18 05:56:47 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Deleted volume successfully. Jul 18 05:56:47 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-78bf7370-caa0-461c-ac2b-374e9f1d7491 tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-ca523901-685d-4026-abc0-56aff39b9d40-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:48 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10" returned: 0 in 0.705s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:56:48 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" returned: 0 in 6.350s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a829d11d-34bd-4456-aab5-52872b076412]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8671ee18-fa88-4bcb-bf5e-2651d9fdd60a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:48 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb Jul 18 05:56:48 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:48 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb Jul 18 05:56:48 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:48 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" returned: 0 in 0.539s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:48 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 Jul 18 05:56:48 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:48 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb" returned: 0 in 0.694s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:56:48 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Converted 1024.00 MB image at 161.24 MB/s Jul 18 05:56:48 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 is being set with open permissions: ugo+rw Jul 18 05:56:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:48 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 Jul 18 05:56:48 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:49 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10" returned: 0 in 0.438s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:49 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" returned: 0 in 0.300s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" released by "_copy_volume_from_snapshot" :: held 8.382s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:49 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10 Jul 18 05:56:49 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-67848fc0-e766-410d-8430-98064ba03a10-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" released by "_create_volume_from_snapshot" :: held 8.422s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.447s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8f0ec4-cb96-4ae2-bf85-1566e75705f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5', 'volume_size': 1, 'snapshot_id': '67848fc0-e766-410d-8430-98064ba03a10'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06932919-aab1-418e-920f-71a63f60db03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:56:49 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Volume volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 (1f94c106-b9c4-4d9f-b7b8-a67086c099e5): created successfully Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06932919-aab1-418e-920f-71a63f60db03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Flow 'volume_create_manager' (76fefd7c-0012-4424-8241-9ef54f55fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:56:49 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a72dace5-836b-4ceb-adcf-e40829ce475f tempest-VolumeDependencyTests-1909271829 None] Created volume successfully. Jul 18 05:56:49 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb.f38dde43-741b-47ec-9ba6-a274a073fb10" returned: 0 in 0.351s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-f38dde43-741b-47ec-9ba6-a274a073fb10" released by "_delete_snapshot" :: held 2.276s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" released by "delete_snapshot" :: held 2.329s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Created reservations ['1f10f043-c492-4441-a456-ca03d62d4433', 'acd49f40-8c17-41d6-b70b-f7c41f0f5b92', '632aee9f-488c-4d1f-94de-1de4d0fdb481', 'b9002572-1acc-4389-b74e-4ebcaaed79fb'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "cinder-67848fc0-e766-410d-8430-98064ba03a10-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-67848fc0-e766-410d-8430-98064ba03a10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "cinder-quobyte-d5076fcf-2b2a-45aa-8482-a67151693adb" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:49 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Delete snapshot completed successfully. Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d01d6298-a99e-47cd-bdf5-23f203875d5f tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-f38dde43-741b-47ec-9ba6-a274a073fb10-delete_snapshot" released by "delete_snapshot" :: held 2.589s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-d5076fcf-2b2a-45aa-8482-a67151693adb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "cinder-quobyte-67848fc0-e766-410d-8430-98064ba03a10" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-67848fc0-e766-410d-8430-98064ba03a10" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Deleting offline snapshot 67848fc0-e766-410d-8430-98064ba03a10 of volume d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] snapshot_file for this snap is: volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f1afbc-aad4-40da-ba33-a76595f737b1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:49 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 Jul 18 05:56:49 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:50 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10" returned: 0 in 0.465s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5076fcf-2b2a-45aa-8482-a67151693adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cae9cf5-ee6e-45ce-87cb-308d71094db9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-09c9d77f-49fa-43e5-9d2e-777c630ef0cb-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-09c9d77f-49fa-43e5-9d2e-777c630ef0cb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:50 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb Jul 18 05:56:50 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "cinder-quobyte-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" acquired by "delete_volume" :: waited 0.047s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b27dd2-9211-4dc9-b54b-57b4945cfcad]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:50 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb Jul 18 05:56:50 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:50 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb" returned: 0 in 0.542s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:50 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 Jul 18 05:56:50 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:51 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" returned: 0 in 0.456s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:51 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb Jul 18 05:56:51 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:51 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10" returned: 0 in 0.457s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:51 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10 Jul 18 05:56:51 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:51 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" returned: 0 in 0.352s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-quobyte-09c9d77f-49fa-43e5-9d2e-777c630ef0cb" released by "delete_volume" :: held 0.933s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Created reservations ['bd70313f-2821-410c-86bb-d44ea40fcb71', '222ce3ef-c3fa-4e45-b206-0c1e05102390', '6048093e-1a82-41dc-b631-d2ca6bd402ea', 'c4b55d6b-23a8-4ec7-b71e-8d34473593d4'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:51 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb.67848fc0-e766-410d-8430-98064ba03a10" returned: 0 in 0.344s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-67848fc0-e766-410d-8430-98064ba03a10" released by "_delete_snapshot" :: held 1.932s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-d5076fcf-2b2a-45aa-8482-a67151693adb" released by "delete_snapshot" :: held 1.981s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:51 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:51 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Created reservations ['19575351-78ba-4603-aead-bfece64c6660', 'a5973a23-5977-4416-b454-51626c077b04', 'f5d6ae3b-e045-4e2a-9b3d-32b169e44d19', '4f2b3fc8-171f-4928-962b-0a6b280d515f'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:51 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Delete snapshot completed successfully. Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-ed492007-34c6-4676-b195-6c1755064dc6 tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-67848fc0-e766-410d-8430-98064ba03a10-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:51 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.369s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:51 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Deleted volume successfully. Jul 18 05:56:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c4310787-9529-4339-9db6-0151a4bbbd5b tempest-CreateVolumesFromSnapshotTest-18739002 None] Lock "cinder-09c9d77f-49fa-43e5-9d2e-777c630ef0cb-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "cinder-d5076fcf-2b2a-45aa-8482-a67151693adb-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-d5076fcf-2b2a-45aa-8482-a67151693adb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "cinder-quobyte-d5076fcf-2b2a-45aa-8482-a67151693adb" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-d5076fcf-2b2a-45aa-8482-a67151693adb" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:53 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efae18c-2902-480e-a478-857a8d8a09b2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:53 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb Jul 18 05:56:53 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:53 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb" returned: 0 in 0.633s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:53 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb Jul 18 05:56:53 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:54 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d5076fcf-2b2a-45aa-8482-a67151693adb" returned: 0 in 0.432s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-d5076fcf-2b2a-45aa-8482-a67151693adb" released by "delete_volume" :: held 1.171s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Created reservations ['5c5d2a83-de91-4c9a-8c74-33cf1a9b08b7', 'ecf85e64-33f5-4ed1-af70-a39382fd5bb0', '4deb122b-5709-4cc2-99bb-5b96cc6a8685', '82bd9a07-c630-466e-baf9-6cc2729ff807'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:54 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:54 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:54 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.337s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:54 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Deleted volume successfully. Jul 18 05:56:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-efa9c165-c926-4bbd-9450-97c89e8532bd tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-d5076fcf-2b2a-45aa-8482-a67151693adb-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "cinder-1f94c106-b9c4-4d9f-b7b8-a67086c099e5-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-1f94c106-b9c4-4d9f-b7b8-a67086c099e5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "cinder-quobyte-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:56:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" acquired by "delete_volume" :: waited 0.033s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:56:55 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6a58f3-e7d6-4449-9744-2500e58d6515]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:56:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:55 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 Jul 18 05:56:55 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:55 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" returned: 0 in 0.462s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:56 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5 Jul 18 05:56:56 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:56 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" returned: 0 in 0.328s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-quobyte-1f94c106-b9c4-4d9f-b7b8-a67086c099e5" released by "delete_volume" :: held 0.850s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:56:56 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Created reservations ['f3b064cb-37fd-4a40-82af-1fe9c00c7294', 'ceee1aad-a08c-451e-b336-73d7d6d2c837', '6d81a4f8-0065-4f69-ab75-c4b9eceba23d', '4f580de6-23d3-4549-b80d-92f5d1dd1541'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:56:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:56 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:56 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:56:56 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:57 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.466s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:57 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Deleted volume successfully. Jul 18 05:56:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-190139ec-511b-4591-9db5-6e7565e2129f tempest-VolumeDependencyTests-1909271829 None] Lock "cinder-1f94c106-b9c4-4d9f-b7b8-a67086c099e5-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Flow 'volume_create_manager' (95a96739-c540-4d25-9d3e-9ab2a55b85fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b57ddca-29ed-4af0-bb2a-2fc5557e20fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b57ddca-29ed-4af0-bb2a-2fc5557e20fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9ad453-2458-4fa9-a4f3-961261f31607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722500aa541045cfb70e0456b9284946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:03Z,use_quota=True,user_id='ffb73cfb5f2740ef9e1612013b36c60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba342673-1b93-45d3-81e9-59e40feddb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba342673-1b93-45d3-81e9-59e40feddb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250e7f8-d257-4a80-b9d3-77321ec1b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.image.glance [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Creating Keystone auth plugin from conf {{(pid=87497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (a4f4bc89-8a0f-49d8-bca6-c3a7103402e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e4a35a-7601-485a-b60a-0f20f0f5790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e4a35a-7601-485a-b60a-0f20f0f5790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746538633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd1f0f0-ddde-42cc-95ff-9595c392f7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:04Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8209f4-cc8a-47f7-ad41-b88571801d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8209f4-cc8a-47f7-ad41-b88571801d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93430f32-4f07-4b97-9d44-615afcc4428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93430f32-4f07-4b97-9d44-615afcc4428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd1f0f0-ddde-42cc-95ff-9595c392f7d5', 'volume_name': 'volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82af226b-5e34-41ee-9beb-db0ffa119cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82af226b-5e34-41ee-9beb-db0ffa119cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff70ce9-c431-4071-9f10-10223f157f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:03 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Volume acd1f0f0-ddde-42cc-95ff-9595c392f7d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5', 'volume_size': 1} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746538633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd1f0f0-ddde-42cc-95ff-9595c392f7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:04Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Creating volume acd1f0f0-ddde-42cc-95ff-9595c392f7d5 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:03 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:03 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 1073741824 Jul 18 05:57:03 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250e7f8-d257-4a80-b9d3-77321ec1b812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec9ad453-2458-4fa9-a4f3-961261f31607', 'volume_name': 'volume-ec9ad453-2458-4fa9-a4f3-961261f31607', 'volume_size': 1, 'image_id': 'b8969341-1a89-484f-babc-e1f4b94ac8b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8969341-1a89-484f-babc-e1f4b94ac8b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12cf62572b783dbb227534bbac5ab159', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '722500aa541045cfb70e0456b9284946', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '253e5ffd639c37518fdc86d75d4899e7667f70013db6ce2b1d6bb379b92369aa3c577f8ccf6114c1aac1756bf780879e7f2e0c34204f7ef5a8b25a6ddbc83ab3', 'id': 'b8969341-1a89-484f-babc-e1f4b94ac8b1', 'created_at': datetime.datetime(2026, 7, 18, 3, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 57, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8969341-1a89-484f-babc-e1f4b94ac8b1/file', 'properties': {}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1086ab2-0895-41f9-a586-cec0a0da71b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1086ab2-0895-41f9-a586-cec0a0da71b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e0f556-07d0-45ab-a23f-b320df7af32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:04 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Volume ec9ad453-2458-4fa9-a4f3-961261f31607: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec9ad453-2458-4fa9-a4f3-961261f31607', 'volume_size': 1, 'image_id': 'b8969341-1a89-484f-babc-e1f4b94ac8b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8969341-1a89-484f-babc-e1f4b94ac8b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12cf62572b783dbb227534bbac5ab159', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '722500aa541045cfb70e0456b9284946', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '253e5ffd639c37518fdc86d75d4899e7667f70013db6ce2b1d6bb379b92369aa3c577f8ccf6114c1aac1756bf780879e7f2e0c34204f7ef5a8b25a6ddbc83ab3', 'id': 'b8969341-1a89-484f-babc-e1f4b94ac8b1', 'created_at': datetime.datetime(2026, 7, 18, 3, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 57, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8969341-1a89-484f-babc-e1f4b94ac8b1/file', 'properties': {}}, 'image_service': } Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Trying to clone ec9ad453-2458-4fa9-a4f3-961261f31607 from image b8969341-1a89-484f-babc-e1f4b94ac8b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8969341-1a89-484f-babc-e1f4b94ac8b1', 'metadata': {}}]). {{(pid=87497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 05:57:04 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Image download 0.00 MB at 0.00 MB/s Jul 18 05:57:04 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 1073741824" returned: 0 in 0.807s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba8704c-7c3f-436b-8868-a08e58c6755c]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:04 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 Jul 18 05:57:04 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:04 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD Jul 18 05:57:04 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:04 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" returned: 0 in 0.339s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:04 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff70ce9-c431-4071-9f10-10223f157f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9596e1-29db-43bd-842f-6287c6a9cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:05 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:05 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Volume volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 (acd1f0f0-ddde-42cc-95ff-9595c392f7d5): created successfully Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9596e1-29db-43bd-842f-6287c6a9cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (a4f4bc89-8a0f-49d8-bca6-c3a7103402e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:05 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-78ace4ec-f06b-4a86-a1f3-ff39303a0526 tempest-ProjectReaderTests-1494172448 None] Created volume successfully. Jul 18 05:57:05 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD Jul 18 05:57:05 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:05 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD" returned: 1 in 0.439s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Temporary image b8969341-1a89-484f-babc-e1f4b94ac8b1 is fetched for user ffb73cfb5f2740ef9e1612013b36c60a. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[328becfc-7da6-451b-ba87-d7fc03df892d]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:05 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD Jul 18 05:57:05 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Creating offline snapshot 8bef5a72-783c-4c82-af48-ff8b8fa6fc5a of volume acd1f0f0-ddde-42cc-95ff-9595c392f7d5 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[07add24c-f3d5-474d-b1a7-73b280a151c1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:05 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 Jul 18 05:57:05 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:06 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD" returned: 0 in 0.516s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:06 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD Jul 18 05:57:06 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:06 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:06 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:06 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" returned: 0 in 0.518s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:06 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a 1G Jul 18 05:57:06 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:06 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.367s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:57:06 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD" returned: 1 in 0.529s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:06 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a 1G" returned: 0 in 0.554s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:06 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a Jul 18 05:57:06 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:07 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a" returned: 0 in 0.372s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:07 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a is being set with open permissions: ugo+rw Jul 18 05:57:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:07 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a Jul 18 05:57:07 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:07 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a" returned: 0 in 0.280s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:07 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.info Jul 18 05:57:07 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:07 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.info" returned: 0 in 0.311s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:07 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.info is being set with open permissions: ugo+rw Jul 18 05:57:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:07 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.info Jul 18 05:57:07 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:08 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.info" returned: 0 in 0.281s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9ad453-2458-4fa9-a4f3-961261f31607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722500aa541045cfb70e0456b9284946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:03Z,use_quota=True,user_id='ffb73cfb5f2740ef9e1612013b36c60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Creating volume ec9ad453-2458-4fa9-a4f3-961261f31607 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:08 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:08 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 1073741824 Jul 18 05:57:08 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:08 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6ba61da8-f519-4857-a51e-4091ec81418d tempest-ProjectReaderTests-1494172448 None] Create snapshot completed successfully Jul 18 05:57:08 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 1073741824" returned: 0 in 0.482s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:08 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 Jul 18 05:57:08 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:09 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607" returned: 0 in 0.286s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Attempting download of b8969341-1a89-484f-babc-e1f4b94ac8b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8969341-1a89-484f-babc-e1f4b94ac8b1', 'metadata': {}}])) to volume ec9ad453-2458-4fa9-a4f3-961261f31607. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab09cb4-eedb-4bf2-a5d3-b53bd7bf17df]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8969341-1a89-484f-babc-e1f4b94ac8b1_e9utz6ov {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-8bef5a72-783c-4c82-af48-ff8b8fa6fc5a-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-8bef5a72-783c-4c82-af48-ff8b8fa6fc5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-8bef5a72-783c-4c82-af48-ff8b8fa6fc5a" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:09 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8969341-1a89-484f-babc-e1f4b94ac8b1_e9utz6ov Jul 18 05:57:09 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-8bef5a72-783c-4c82-af48-ff8b8fa6fc5a" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Deleting offline snapshot 8bef5a72-783c-4c82-af48-ff8b8fa6fc5a of volume acd1f0f0-ddde-42cc-95ff-9595c392f7d5 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] snapshot_file for this snap is: volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af05929-1127-417d-a8e6-a79c432e7d47]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:09 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a Jul 18 05:57:09 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:09 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8969341-1a89-484f-babc-e1f4b94ac8b1_e9utz6ov" returned: 0 in 0.455s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8969341-1a89-484f-babc-e1f4b94ac8b1_e9utz6ov {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:09 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8969341-1a89-484f-babc-e1f4b94ac8b1_e9utz6ov Jul 18 05:57:09 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:10 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a" returned: 0 in 0.516s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[73724c5c-27fa-44cf-9510-6c7e7f811bf1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:10 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8969341-1a89-484f-babc-e1f4b94ac8b1_e9utz6ov" returned: 1 in 0.439s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8969341-1a89-484f-babc-e1f4b94ac8b1_e9utz6ov' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d170ad-09d7-4c1e-84a4-413f4de6d3cc]: (4, 'raw') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:10 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 Jul 18 05:57:10 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:10 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD Jul 18 05:57:10 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:10 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" returned: 0 in 0.506s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:10 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:10 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a Jul 18 05:57:10 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:10 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD Jul 18 05:57:10 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:11 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a" returned: 0 in 0.565s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:11 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a Jul 18 05:57:11 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:11 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD" returned: 1 in 0.690s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] b8969341-1a89-484f-babc-e1f4b94ac8b1 was raw, converting to qcow2 {{(pid=87497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:11 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 Jul 18 05:57:11 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:11 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5.8bef5a72-783c-4c82-af48-ff8b8fa6fc5a" returned: 0 in 0.447s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-8bef5a72-783c-4c82-af48-ff8b8fa6fc5a" released by "_delete_snapshot" :: held 2.202s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" released by "delete_snapshot" :: held 2.252s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Created reservations ['2623db5e-69ba-4808-bdbe-8d5436acbc57', '000cb092-db09-4b83-ad15-78ec975fe7c3', 'e6617602-1fe0-4f38-9462-7b406ee88eb2', 'd3217568-d8c7-4e9e-b139-86e638a129d1'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:11 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Delete snapshot completed successfully. Jul 18 05:57:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d9d12369-9709-454b-83b8-9e0dc5aa8712 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-8bef5a72-783c-4c82-af48-ff8b8fa6fc5a-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:12 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607" returned: 0 in 0.733s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8969341-1a89-484f-babc-e1f4b94ac8b1_l4dtqqr4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:57:12 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Converted 0.00 MB image at 0.00 MB/s Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:12 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 1G Jul 18 05:57:12 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 1G" returned: 0 in 0.577s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Downloaded image b8969341-1a89-484f-babc-e1f4b94ac8b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8969341-1a89-484f-babc-e1f4b94ac8b1', 'metadata': {}}])) to volume ec9ad453-2458-4fa9-a4f3-961261f31607 successfully. {{(pid=87497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Temporary image b8969341-1a89-484f-babc-e1f4b94ac8b1 for user ffb73cfb5f2740ef9e1612013b36c60a is deleted. {{(pid=87497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.volume.volume_utils [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Marking volume ec9ad453-2458-4fa9-a4f3-961261f31607 as bootable. {{(pid=87497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 05:57:12 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Copying metadata from image b8969341-1a89-484f-babc-e1f4b94ac8b1 to ec9ad453-2458-4fa9-a4f3-961261f31607. {{(pid=87497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Creating volume glance metadata for volume ec9ad453-2458-4fa9-a4f3-961261f31607 backed by image b8969341-1a89-484f-babc-e1f4b94ac8b1 with: {'image_id': 'b8969341-1a89-484f-babc-e1f4b94ac8b1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '12cf62572b783dbb227534bbac5ab159', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-acd1f0f0-ddde-42cc-95ff-9595c392f7d5-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Lock "cinder-acd1f0f0-ddde-42cc-95ff-9595c392f7d5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e0f556-07d0-45ab-a23f-b320df7af32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9ad453-2458-4fa9-a4f3-961261f31607', 'volume_size': 1, 'image_id': 'b8969341-1a89-484f-babc-e1f4b94ac8b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8969341-1a89-484f-babc-e1f4b94ac8b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12cf62572b783dbb227534bbac5ab159', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '722500aa541045cfb70e0456b9284946', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '253e5ffd639c37518fdc86d75d4899e7667f70013db6ce2b1d6bb379b92369aa3c577f8ccf6114c1aac1756bf780879e7f2e0c34204f7ef5a8b25a6ddbc83ab3', 'id': 'b8969341-1a89-484f-babc-e1f4b94ac8b1', 'created_at': datetime.datetime(2026, 7, 18, 3, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 57, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8969341-1a89-484f-babc-e1f4b94ac8b1/file', 'properties': {}}, 'image_service': }' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb52fa07-bcbd-4421-99f5-9dc4b7ae73ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" acquired by "delete_volume" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:12 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Volume volume-ec9ad453-2458-4fa9-a4f3-961261f31607 (ec9ad453-2458-4fa9-a4f3-961261f31607): created successfully Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb52fa07-bcbd-4421-99f5-9dc4b7ae73ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Flow 'volume_create_manager' (95a96739-c540-4d25-9d3e-9ab2a55b85fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75f8c72-e2c1-4954-a7bf-6ae9219c6828]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:12 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-b550e3c4-904e-4cc7-bcc3-e82e6af9c78e tempest-VolumeImageDependencyTests-350575576 None] Created volume successfully. Jul 18 05:57:13 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 Jul 18 05:57:13 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Acquiring lock "cinder-ec9ad453-2458-4fa9-a4f3-961261f31607-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Lock "cinder-ec9ad453-2458-4fa9-a4f3-961261f31607-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Acquiring lock "cinder-quobyte-ec9ad453-2458-4fa9-a4f3-961261f31607" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Lock "cinder-quobyte-ec9ad453-2458-4fa9-a4f3-961261f31607" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b802f229-a5fd-4859-a71f-5f9031a386e6]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:13 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" returned: 0 in 0.599s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:13 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5 Jul 18 05:57:13 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:13 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 Jul 18 05:57:13 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:13 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-acd1f0f0-ddde-42cc-95ff-9595c392f7d5" released by "delete_volume" :: held 0.974s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=185,cinder:UPDATE=248,cinder:INSERT=73,cinder:DELETE=26 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Created reservations ['480920ff-bd3c-4e49-a0eb-8ec2c8307fab', '17afa447-0a24-4f24-848d-539d5aaedc16', 'abc64ffb-87d2-4982-9b92-b0d525f50646', '9784b757-6cdb-4347-9f9d-caf6a10f5206'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:14 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:14 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:14 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607" returned: 0 in 0.584s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:14 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607 Jul 18 05:57:14 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:14 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.325s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Deleted volume successfully. Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=187,cinder:UPDATE=260,cinder:INSERT=64,cinder:DELETE=20 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:57:14 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ec9ad453-2458-4fa9-a4f3-961261f31607" returned: 0 in 0.329s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-008d3650-0eb8-4c89-bd58-2631b233202e tempest-ProjectReaderTests-1494172448 None] Lock "cinder-acd1f0f0-ddde-42cc-95ff-9595c392f7d5-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Lock "cinder-quobyte-ec9ad453-2458-4fa9-a4f3-961261f31607" released by "delete_volume" :: held 0.972s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Created reservations ['4c29ebf5-dc94-45f4-8015-d41e2b2795a2', '5a6629c1-1cbd-440a-ad12-208f0f25167b', '6d3eea0b-0e6a-49e9-9214-c9bfc8431eff', '8e0e2d1b-e661-4e9d-90a4-2ee7d051e0c2'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:14 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:14 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:14 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.352s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Deleted volume successfully. Jul 18 05:57:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-33aace14-62d1-4a63-a8ff-eb92485f6065 tempest-VolumeImageDependencyTests-350575576 None] Lock "cinder-ec9ad453-2458-4fa9-a4f3-961261f31607-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (1dde30f8-3d93-4437-bb0c-a80a42b72e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ec0b71-39b6-4b00-87e0-ffc8316d7ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ec0b71-39b6-4b00-87e0-ffc8316d7ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441221352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245091c8-b0cb-4707-8815-3e9da4b7322c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:16Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b3ffee-a6a6-44a8-97cc-da95d26be79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b3ffee-a6a6-44a8-97cc-da95d26be79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5646d972-95d7-4055-8f90-7a3540f5d949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5646d972-95d7-4055-8f90-7a3540f5d949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245091c8-b0cb-4707-8815-3e9da4b7322c', 'volume_name': 'volume-245091c8-b0cb-4707-8815-3e9da4b7322c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28b6f89-79a3-4137-909c-55c8d629ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28b6f89-79a3-4137-909c-55c8d629ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571cfcb4-0e70-4fea-a8ae-8585638bf679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Volume 245091c8-b0cb-4707-8815-3e9da4b7322c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245091c8-b0cb-4707-8815-3e9da4b7322c', 'volume_size': 1} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441221352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245091c8-b0cb-4707-8815-3e9da4b7322c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:16Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Creating volume 245091c8-b0cb-4707-8815-3e9da4b7322c {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:15 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:15 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c 1073741824 Jul 18 05:57:15 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:16 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c 1073741824" returned: 0 in 0.628s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:16 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c Jul 18 05:57:16 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Flow 'volume_create_manager' (48f9fdb4-6357-4d36-bc90-1c2e06aaa01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccc4dea-0a59-4b5e-b100-4953aa208377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccc4dea-0a59-4b5e-b100-4953aa208377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1757204959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6063c4f9-ae40-45d3-8e08-a2ae7b8581f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d542aac8538f4c66a22215110e234f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:17Z,use_quota=True,user_id='f4cea86fa3d74943a421b932969ddb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470f61ed-c3e1-4d8e-b80e-6b59d20095b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470f61ed-c3e1-4d8e-b80e-6b59d20095b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f151a5b0-aa70-4c03-8f95-171c09670a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f151a5b0-aa70-4c03-8f95-171c09670a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6063c4f9-ae40-45d3-8e08-a2ae7b8581f3', 'volume_name': 'volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d188efd-b10a-495c-bb9f-7e8d7b18811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d188efd-b10a-495c-bb9f-7e8d7b18811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135e63f1-000b-4132-a8c8-ea24e9851eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Volume 6063c4f9-ae40-45d3-8e08-a2ae7b8581f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3', 'volume_size': 1} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:16 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c" returned: 0 in 0.341s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1757204959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6063c4f9-ae40-45d3-8e08-a2ae7b8581f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d542aac8538f4c66a22215110e234f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:17Z,use_quota=True,user_id='f4cea86fa3d74943a421b932969ddb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Creating volume 6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:16 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:16 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 1073741824 Jul 18 05:57:16 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571cfcb4-0e70-4fea-a8ae-8585638bf679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245091c8-b0cb-4707-8815-3e9da4b7322c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5265d399-49e3-43b1-a02a-ee6b46ea4034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Volume volume-245091c8-b0cb-4707-8815-3e9da4b7322c (245091c8-b0cb-4707-8815-3e9da4b7322c): created successfully Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5265d399-49e3-43b1-a02a-ee6b46ea4034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (1dde30f8-3d93-4437-bb0c-a80a42b72e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:16 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-80eb9665-cc35-41ae-93e8-daf769400726 tempest-ProjectReaderTests-1494172448 None] Created volume successfully. Jul 18 05:57:17 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 1073741824" returned: 0 in 0.542s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:17 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 Jul 18 05:57:17 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:17 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" returned: 0 in 0.317s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135e63f1-000b-4132-a8c8-ea24e9851eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27344b48-b967-4072-ab90-d47601ab6817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:17 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Volume volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 (6063c4f9-ae40-45d3-8e08-a2ae7b8581f3): created successfully Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27344b48-b967-4072-ab90-d47601ab6817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Flow 'volume_create_manager' (48f9fdb4-6357-4d36-bc90-1c2e06aaa01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:17 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e85d9faf-ceda-4224-a7a6-96058b1547f2 tempest-SnapshotDependencyTests-896249807 None] Created volume successfully. Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Creating offline snapshot d09ef3f4-a522-49c0-8ccb-11330ac73e0b of volume 245091c8-b0cb-4707-8815-3e9da4b7322c {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b52b16-5c37-4cf1-aaa9-1224da37a54c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:18 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c Jul 18 05:57:18 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:18 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c" returned: 0 in 0.447s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:18 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b 1G Jul 18 05:57:18 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:18 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b 1G" returned: 0 in 0.512s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245091c8-b0cb-4707-8815-3e9da4b7322c -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:18 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245091c8-b0cb-4707-8815-3e9da4b7322c -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b Jul 18 05:57:18 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:19 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-245091c8-b0cb-4707-8815-3e9da4b7322c -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b" returned: 0 in 0.329s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:19 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b is being set with open permissions: ugo+rw Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:19 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b Jul 18 05:57:19 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:19 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Flow 'volume_create_manager' (85aa32f7-7422-4ae8-8afe-d0f0086d4bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4335ce6-de91-4358-9f3d-c56ddd50ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b" returned: 0 in 0.352s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4335ce6-de91-4358-9f3d-c56ddd50ee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47947fee-356b-4d9b-aca3-2a36cb4b01f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47d462a4eb44838bb7ee6098f09750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:20Z,use_quota=True,user_id='c1475391d0604ce0901beb60711212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a055021-602e-4e3e-b0ba-eb6ecf9792d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a055021-602e-4e3e-b0ba-eb6ecf9792d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f2972c-034d-472f-ad4f-c376b03d2f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f2972c-034d-472f-ad4f-c376b03d2f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47947fee-356b-4d9b-aca3-2a36cb4b01f0', 'volume_name': 'volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66f05a0-9a5f-43f7-8592-426452173b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66f05a0-9a5f-43f7-8592-426452173b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad29a23-244d-4919-a9c3-d7ed7a20463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:19 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Volume 47947fee-356b-4d9b-aca3-2a36cb4b01f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0', 'volume_size': 1} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:19 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.info Jul 18 05:57:19 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:19 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.info" returned: 0 in 0.279s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:19 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.info is being set with open permissions: ugo+rw Jul 18 05:57:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:20 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.info Jul 18 05:57:20 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:20 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.info" returned: 0 in 0.261s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.295s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Creating offline snapshot cdfb6a77-73de-4e97-a2dc-0ae5685bc62d of volume 6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:57:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-64570281-8209-4b9a-bd25-2be7440abff9 tempest-ProjectReaderTests-1494172448 None] Create snapshot completed successfully Jul 18 05:57:20 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ecf45e-cd4f-4012-a1a2-e8508691b6e8]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:20 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 Jul 18 05:57:20 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:20 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" returned: 0 in 0.417s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:20 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d 1G Jul 18 05:57:20 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-d09ef3f4-a522-49c0-8ccb-11330ac73e0b-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-d09ef3f4-a522-49c0-8ccb-11330ac73e0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-245091c8-b0cb-4707-8815-3e9da4b7322c" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-245091c8-b0cb-4707-8815-3e9da4b7322c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-d09ef3f4-a522-49c0-8ccb-11330ac73e0b" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-d09ef3f4-a522-49c0-8ccb-11330ac73e0b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Deleting offline snapshot d09ef3f4-a522-49c0-8ccb-11330ac73e0b of volume 245091c8-b0cb-4707-8815-3e9da4b7322c {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] snapshot_file for this snap is: volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:57:21 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cf7d55-5213-4734-a7df-a2570acdf9be]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d 1G" returned: 0 in 0.532s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:21 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d Jul 18 05:57:21 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:21 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b Jul 18 05:57:21 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:21 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d" returned: 0 in 0.318s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:21 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d is being set with open permissions: ugo+rw Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:21 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d Jul 18 05:57:21 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:21 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b" returned: 0 in 0.404s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-245091c8-b0cb-4707-8815-3e9da4b7322c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[094e309a-ade6-4605-8f9d-e2746e3e7c6a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:21 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c Jul 18 05:57:21 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:21 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d" returned: 0 in 0.276s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:21 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.info Jul 18 05:57:21 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:22 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c" returned: 0 in 0.412s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:22 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b Jul 18 05:57:22 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:22 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.info" returned: 0 in 0.329s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:22 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.info is being set with open permissions: ugo+rw Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:22 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.info Jul 18 05:57:22 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:22 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.info" returned: 0 in 0.252s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.833s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:22 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47947fee-356b-4d9b-aca3-2a36cb4b01f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47d462a4eb44838bb7ee6098f09750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:20Z,use_quota=True,user_id='c1475391d0604ce0901beb60711212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Creating volume 47947fee-356b-4d9b-aca3-2a36cb4b01f0 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:22 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b" returned: 0 in 0.418s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:22 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 1073741824 Jul 18 05:57:22 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:22 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b Jul 18 05:57:22 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:22 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-78c019a9-3eae-422c-88d4-af6752a2007e tempest-SnapshotDependencyTests-896249807 None] Create snapshot completed successfully Jul 18 05:57:22 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c.d09ef3f4-a522-49c0-8ccb-11330ac73e0b" returned: 0 in 0.324s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-d09ef3f4-a522-49c0-8ccb-11330ac73e0b" released by "_delete_snapshot" :: held 1.682s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:22 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-245091c8-b0cb-4707-8815-3e9da4b7322c" released by "delete_snapshot" :: held 1.709s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Created reservations ['f32572c0-cf5a-463d-a173-e39483828580', '3b30db6a-df69-4547-9cdf-3d9205c678ab', '381b3465-b760-434a-907c-81055d3e28a8', 'a9407453-4387-484a-be6c-4a0230296547'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:23 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Flow 'volume_create_manager' (8fcc9d1e-cf52-4b91-ba9f-a2f5ba07aaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f617fad-298a-42dc-b054-3be3ed703c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 1073741824" returned: 0 in 0.568s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f617fad-298a-42dc-b054-3be3ed703c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013708232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737aa32c-3fe3-4e63-8194-c650d28576b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e590c81504e8297ded44d8c42f830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:23Z,use_quota=True,user_id='a5f81262ff984832bf3fca8d420b22d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442e625e-7ede-4683-9dd2-983379904423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442e625e-7ede-4683-9dd2-983379904423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1eafcf9-4526-44f3-a40e-5b2165263f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1eafcf9-4526-44f3-a40e-5b2165263f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '737aa32c-3fe3-4e63-8194-c650d28576b5', 'volume_name': 'volume-737aa32c-3fe3-4e63-8194-c650d28576b5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3573d8fd-93c1-4d9e-9e9f-10e5580ea56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3573d8fd-93c1-4d9e-9e9f-10e5580ea56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31acf546-200c-4c71-8ff9-4cd5a8ed557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Volume 737aa32c-3fe3-4e63-8194-c650d28576b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-737aa32c-3fe3-4e63-8194-c650d28576b5', 'volume_size': 1} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:23 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 Jul 18 05:57:23 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:23 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Delete snapshot completed successfully. Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4fa216c0-b3f3-4cd7-b14f-b479598b5c79 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-d09ef3f4-a522-49c0-8ccb-11330ac73e0b-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-245091c8-b0cb-4707-8815-3e9da4b7322c-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Lock "cinder-245091c8-b0cb-4707-8815-3e9da4b7322c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-245091c8-b0cb-4707-8815-3e9da4b7322c" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-245091c8-b0cb-4707-8815-3e9da4b7322c" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9521e99a-6a68-4794-848c-bc9d45426f6c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:23 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0" returned: 0 in 0.337s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013708232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737aa32c-3fe3-4e63-8194-c650d28576b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e590c81504e8297ded44d8c42f830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:23Z,use_quota=True,user_id='a5f81262ff984832bf3fca8d420b22d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Creating volume 737aa32c-3fe3-4e63-8194-c650d28576b5 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:23 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad29a23-244d-4919-a9c3-d7ed7a20463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b53a661-1fe1-4322-ab7d-c6490b6a726f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5 1073741824 Jul 18 05:57:23 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:23 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Volume volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 (47947fee-356b-4d9b-aca3-2a36cb4b01f0): created successfully Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b53a661-1fe1-4322-ab7d-c6490b6a726f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Flow 'volume_create_manager' (85aa32f7-7422-4ae8-8afe-d0f0086d4bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:23 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-facf0007-8d7e-4fcb-a225-fff6e2933542 tempest-CinderUnicodeTest-1842685695 None] Created volume successfully. Jul 18 05:57:23 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c Jul 18 05:57:23 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Flow 'volume_create_manager' (46f05e1f-dcdb-444d-82e7-34206c59a1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfa798b-d8f4-43fa-83a0-730ac78709c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfa798b-d8f4-43fa-83a0-730ac78709c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d62887-17a1-49d7-b819-332e4cf67b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d542aac8538f4c66a22215110e234f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cdfb6a77-73de-4e97-a2dc-0ae5685bc62d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:24Z,use_quota=True,user_id='f4cea86fa3d74943a421b932969ddb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73a9d50-f04b-484d-8cde-94c67e388bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73a9d50-f04b-484d-8cde-94c67e388bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1491c8c9-3bc7-47f6-be91-9d15f8517e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1491c8c9-3bc7-47f6-be91-9d15f8517e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4d62887-17a1-49d7-b819-332e4cf67b6e', 'volume_name': 'volume-d4d62887-17a1-49d7-b819-332e4cf67b6e', 'volume_size': 1, 'snapshot_id': 'cdfb6a77-73de-4e97-a2dc-0ae5685bc62d'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb59ef2-c86e-4f07-ab3d-52300de38319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb59ef2-c86e-4f07-ab3d-52300de38319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca211721-3425-41c7-ae57-18f869cbdf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:23 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Volume d4d62887-17a1-49d7-b819-332e4cf67b6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4d62887-17a1-49d7-b819-332e4cf67b6e', 'volume_size': 1, 'snapshot_id': 'cdfb6a77-73de-4e97-a2dc-0ae5685bc62d'} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:23 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c" returned: 0 in 0.483s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:24 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c Jul 18 05:57:24 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:24 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5 1073741824" returned: 0 in 0.575s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:24 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5 Jul 18 05:57:24 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:24 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-245091c8-b0cb-4707-8815-3e9da4b7322c" returned: 0 in 0.298s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-245091c8-b0cb-4707-8815-3e9da4b7322c" released by "delete_volume" :: held 0.865s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Created reservations ['82baf99b-8690-4bee-b69c-026e40742615', 'f8ba6dc7-a997-4212-9ff7-43cbe54ca964', '87fac6e1-f14d-488a-aa66-9ad879cbf91f', '76d378f5-024d-4712-ab00-699c8fc0e5ae'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:24 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5" returned: 0 in 0.285s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.481s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "cinder-quobyte-cdfb6a77-73de-4e97-a2dc-0ae5685bc62d-d4d62887-17a1-49d7-b819-332e4cf67b6e" by "_create_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31acf546-200c-4c71-8ff9-4cd5a8ed557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-737aa32c-3fe3-4e63-8194-c650d28576b5', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6e5271-0646-4c09-9056-acc0401c75b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-cdfb6a77-73de-4e97-a2dc-0ae5685bc62d-d4d62887-17a1-49d7-b819-332e4cf67b6e" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Creating volume d4d62887-17a1-49d7-b819-332e4cf67b6e from snapshot cdfb6a77-73de-4e97-a2dc-0ae5685bc62d {{(pid=87497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "cinder-quobyte-d4d62887-17a1-49d7-b819-332e4cf67b6e" by "_copy_volume_from_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:24 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Volume volume-737aa32c-3fe3-4e63-8194-c650d28576b5 (737aa32c-3fe3-4e63-8194-c650d28576b5): created successfully Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6e5271-0646-4c09-9056-acc0401c75b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Flow 'volume_create_manager' (8fcc9d1e-cf52-4b91-ba9f-a2f5ba07aaff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Flow 'volume_create_manager' (009ef8fd-d5d5-420d-8e67-69510a71a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac82013e-a640-4445-a033-21ecb2af0c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-d4d62887-17a1-49d7-b819-332e4cf67b6e" acquired by "_copy_volume_from_snapshot" :: waited 0.082s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] snapshot: cdfb6a77-73de-4e97-a2dc-0ae5685bc62d, volume: d4d62887-17a1-49d7-b819-332e4cf67b6e, {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 05:57:24 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-018330f5-cdc5-430d-9381-230e75bc5886 tempest-ProjectReaderTests-1058351424 None] Created volume successfully. Jul 18 05:57:24 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:24 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac82013e-a640-4445-a033-21ecb2af0c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1031780885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906665ac-5f4a-4df2-926d-9980e61d4c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47d462a4eb44838bb7ee6098f09750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:24Z,use_quota=True,user_id='c1475391d0604ce0901beb60711212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd07de94-0a91-4e6a-b5d9-0df56624be36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd07de94-0a91-4e6a-b5d9-0df56624be36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f215fbed-89e5-43cb-81cd-ba9bc5b25545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f215fbed-89e5-43cb-81cd-ba9bc5b25545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906665ac-5f4a-4df2-926d-9980e61d4c85', 'volume_name': 'volume-906665ac-5f4a-4df2-926d-9980e61d4c85', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013b8da8-07cf-4f91-bed1-a22a6dd23bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013b8da8-07cf-4f91-bed1-a22a6dd23bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d69d04e-aed7-47b8-83a1-069ecdd719f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:24 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Volume 906665ac-5f4a-4df2-926d-9980e61d4c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906665ac-5f4a-4df2-926d-9980e61d4c85', 'volume_size': 1} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad9f7ee-ca88-4e00-92da-df4b33b084c7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:24 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d Jul 18 05:57:24 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:24 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:24 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Deleted volume successfully. Jul 18 05:57:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-eec7fe15-b4c7-4fb3-a4f6-f19eebdfcfef tempest-ProjectReaderTests-1494172448 None] Lock "cinder-245091c8-b0cb-4707-8815-3e9da4b7322c-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (312c3b99-7116-428c-a9a4-d44826c98271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04817339-f343-4ac1-8c52-91aeb6bec91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04817339-f343-4ac1-8c52-91aeb6bec91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267679621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e742096-c9ff-4139-ad2f-619efa6a6e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:25Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25479b65-281f-4180-84ba-987157b1871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25479b65-281f-4180-84ba-987157b1871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0e2922-d502-461a-9461-f7b27063e4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0e2922-d502-461a-9461-f7b27063e4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e742096-c9ff-4139-ad2f-619efa6a6e5a', 'volume_name': 'volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9408eda-81f4-4f90-b400-601f02d47af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9408eda-81f4-4f90-b400-601f02d47af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b095ee-a84a-4f22-b86f-2de0855e5b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:25 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Volume 8e742096-c9ff-4139-ad2f-619efa6a6e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a', 'volume_size': 1} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:25 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d" returned: 0 in 0.448s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Creating direct copy from snapshot {{(pid=87497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ad276-2702-4df5-b212-12bbf29c8fde]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:25 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 Jul 18 05:57:25 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Acquiring lock "cinder-737aa32c-3fe3-4e63-8194-c650d28576b5-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Lock "cinder-737aa32c-3fe3-4e63-8194-c650d28576b5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Acquiring lock "cinder-quobyte-737aa32c-3fe3-4e63-8194-c650d28576b5" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Lock "cinder-quobyte-737aa32c-3fe3-4e63-8194-c650d28576b5" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f13ff7-ab1a-449d-8af8-475c4fb80031]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:25 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5 Jul 18 05:57:25 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:25 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" returned: 0 in 0.406s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG cinder.utils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Path /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e not found in is_blk_device check {{(pid=87497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:25 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e Jul 18 05:57:25 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:25 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5" returned: 0 in 0.374s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:25 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5 Jul 18 05:57:25 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:26 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-737aa32c-3fe3-4e63-8194-c650d28576b5" returned: 0 in 0.277s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Lock "cinder-quobyte-737aa32c-3fe3-4e63-8194-c650d28576b5" released by "delete_volume" :: held 0.713s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Created reservations ['489fd0a8-9d65-47f8-b7d9-f0fc4f08486e', '273ae693-04c4-45ba-9d7f-3dec70df2775', '61aed393-e0b0-4cd4-aba0-ce8f84682744', '38b8454c-6505-4216-b620-69eb87dd97c0'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:26 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:26 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:26 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.569s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:26 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:26 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Deleted volume successfully. Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a98b559c-38e6-4af7-b62e-39479d05871c tempest-ProjectReaderTests-1058351424 None] Lock "cinder-737aa32c-3fe3-4e63-8194-c650d28576b5-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Flow 'volume_create_manager' (9fb13bdb-8b40-482b-8c54-c91d5ddd7936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8102cb-ccf6-4463-b7d2-1fc6e25d6247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8102cb-ccf6-4463-b7d2-1fc6e25d6247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235454802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e590c81504e8297ded44d8c42f830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:28Z,use_quota=True,user_id='a5f81262ff984832bf3fca8d420b22d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7f5eba-624b-4413-95c8-d16146066094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7f5eba-624b-4413-95c8-d16146066094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d42153-4db4-43b4-a2e5-7afbc4c30511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d42153-4db4-43b4-a2e5-7afbc4c30511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c', 'volume_name': 'volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5660e98-4652-4486-a354-f823e69d1669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5660e98-4652-4486-a354-f823e69d1669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce8c9c6-8d0e-4fb9-b9ee-ad9b8c6dd50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:27 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Volume e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c', 'volume_size': 1} Jul 18 05:57:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:30 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e" returned: 0 in 4.717s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:30 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaf1fce-932a-4f4c-8454-5d11a096d4e7]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:30 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 Jul 18 05:57:30 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:30 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" returned: 0 in 0.533s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:30 devstack cinder-volume[87497]: DEBUG cinder.image.image_utils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Image conversion details: src /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e {{(pid=87497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 05:57:30 devstack cinder-volume[87497]: INFO cinder.image.image_utils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Converted 1024.00 MB image at 217.04 MB/s Jul 18 05:57:30 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e is being set with open permissions: ugo+rw Jul 18 05:57:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:30 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e Jul 18 05:57:30 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:31 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e" returned: 0 in 0.236s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-d4d62887-17a1-49d7-b819-332e4cf67b6e" released by "_copy_volume_from_snapshot" :: held 6.490s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-cdfb6a77-73de-4e97-a2dc-0ae5685bc62d-d4d62887-17a1-49d7-b819-332e4cf67b6e" released by "_create_volume_from_snapshot" :: held 6.588s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.642s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.450s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1031780885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906665ac-5f4a-4df2-926d-9980e61d4c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47d462a4eb44838bb7ee6098f09750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:24Z,use_quota=True,user_id='c1475391d0604ce0901beb60711212be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Creating volume 906665ac-5f4a-4df2-926d-9980e61d4c85 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:31 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:31 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 1073741824 Jul 18 05:57:31 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca211721-3425-41c7-ae57-18f869cbdf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d62887-17a1-49d7-b819-332e4cf67b6e', 'volume_size': 1, 'snapshot_id': 'cdfb6a77-73de-4e97-a2dc-0ae5685bc62d'}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea99244b-050c-44de-97e7-d75a4839cf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Volume volume-d4d62887-17a1-49d7-b819-332e4cf67b6e (d4d62887-17a1-49d7-b819-332e4cf67b6e): created successfully Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea99244b-050c-44de-97e7-d75a4839cf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Flow 'volume_create_manager' (46f05e1f-dcdb-444d-82e7-34206c59a1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-16700a13-4b62-49d5-8d13-b759c92ada57 tempest-SnapshotDependencyTests-896249807 None] Created volume successfully. Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "cinder-cdfb6a77-73de-4e97-a2dc-0ae5685bc62d-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:31 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 1073741824" returned: 0 in 0.456s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-cdfb6a77-73de-4e97-a2dc-0ae5685bc62d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "cinder-quobyte-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "cinder-quobyte-cdfb6a77-73de-4e97-a2dc-0ae5685bc62d" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-cdfb6a77-73de-4e97-a2dc-0ae5685bc62d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Deleting offline snapshot cdfb6a77-73de-4e97-a2dc-0ae5685bc62d of volume 6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] snapshot_file for this snap is: volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[21794073-796e-477d-99f4-87e5e721f3e4]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:31 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 Jul 18 05:57:31 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:31 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d Jul 18 05:57:31 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:31 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85" returned: 0 in 0.241s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.773s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267679621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e742096-c9ff-4139-ad2f-619efa6a6e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:25Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Creating volume 8e742096-c9ff-4139-ad2f-619efa6a6e5a {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:31 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:31 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a 1073741824 Jul 18 05:57:31 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d69d04e-aed7-47b8-83a1-069ecdd719f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906665ac-5f4a-4df2-926d-9980e61d4c85', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2f4af0-cea3-4f2e-9e5e-66cb742717e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:31 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Volume volume-906665ac-5f4a-4df2-926d-9980e61d4c85 (906665ac-5f4a-4df2-926d-9980e61d4c85): created successfully Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2f4af0-cea3-4f2e-9e5e-66cb742717e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:31 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Flow 'volume_create_manager' (009ef8fd-d5d5-420d-8e67-69510a71a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:31 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-257acc1d-4b70-46fc-8e35-96f8f814f142 tempest-CinderUnicodeTest-1842685695 None] Created volume successfully. Jul 18 05:57:32 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d" returned: 0 in 0.382s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[817cb2ae-3598-4b57-83df-d1945361f33e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:32 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 Jul 18 05:57:32 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:32 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a 1073741824" returned: 0 in 0.558s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:32 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" returned: 0 in 0.454s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:32 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a Jul 18 05:57:32 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:32 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d Jul 18 05:57:32 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:32 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a" returned: 0 in 0.266s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.841s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235454802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e590c81504e8297ded44d8c42f830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:28Z,use_quota=True,user_id='a5f81262ff984832bf3fca8d420b22d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Creating volume e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:32 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b095ee-a84a-4f22-b86f-2de0855e5b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:32 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c 1073741824 Jul 18 05:57:32 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e63af2e-29bc-4599-9f5b-f545fd2e4e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:32 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Volume volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a (8e742096-c9ff-4139-ad2f-619efa6a6e5a): created successfully Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e63af2e-29bc-4599-9f5b-f545fd2e4e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (312c3b99-7116-428c-a9a4-d44826c98271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-08353a3d-6a96-49e7-8647-9fe3562f9b4f tempest-ProjectReaderTests-1494172448 None] Created volume successfully. Jul 18 05:57:32 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d" returned: 0 in 0.352s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:32 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d Jul 18 05:57:32 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:33 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3.cdfb6a77-73de-4e97-a2dc-0ae5685bc62d" returned: 0 in 0.286s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-cdfb6a77-73de-4e97-a2dc-0ae5685bc62d" released by "_delete_snapshot" :: held 1.597s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" released by "delete_snapshot" :: held 1.622s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:33 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Created reservations ['22be8b2c-f34f-409f-8443-a96bbc38bae7', 'ca6e2bcc-f0e0-4f4d-aa04-f2e6fc91385c', '455fe54e-7b8a-490b-8842-5cdc5051a147', '101a503b-6fce-4135-9691-07dce9f51c4c'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c 1073741824" returned: 0 in 0.483s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:33 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c Jul 18 05:57:33 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Delete snapshot completed successfully. Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0abf7a8f-39f0-411a-a8cc-e86756df132b tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-cdfb6a77-73de-4e97-a2dc-0ae5685bc62d-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:33 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c" returned: 0 in 0.260s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.077s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce8c9c6-8d0e-4fb9-b9ee-ad9b8c6dd50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9f1687-afcd-4e5d-bc02-af08c1c8135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Creating offline snapshot a9950a31-2167-4306-b197-c1954183323d of volume 906665ac-5f4a-4df2-926d-9980e61d4c85 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:57:33 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Volume volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c (e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c): created successfully Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9f1687-afcd-4e5d-bc02-af08c1c8135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Flow 'volume_create_manager' (9fb13bdb-8b40-482b-8c54-c91d5ddd7936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c53abf-ae1b-459e-916d-f87b5dbfb236]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:33 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4ce8bf72-3616-4717-868f-103ec5d7c1cd tempest-ProjectReaderTests-1058351424 None] Created volume successfully. Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "cinder-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "cinder-quobyte-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:33 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 Jul 18 05:57:33 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" acquired by "delete_volume" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cedc6d-d44a-4c42-b9ae-91e31614eac5]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:33 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 Jul 18 05:57:33 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:34 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85" returned: 0 in 0.432s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:34 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d 1G Jul 18 05:57:34 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:34 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" returned: 0 in 0.426s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:34 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3 Jul 18 05:57:34 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Acquiring lock "cinder-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Lock "cinder-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Acquiring lock "cinder-quobyte-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Lock "cinder-quobyte-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c" acquired by "delete_volume" :: waited 0.030s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[559e2d07-2105-415a-8d30-9544a55b4824]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:34 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" returned: 0 in 0.331s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:34 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d 1G" returned: 0 in 0.570s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906665ac-5f4a-4df2-926d-9980e61d4c85 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:34 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3" released by "delete_volume" :: held 0.856s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:34 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:34 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906665ac-5f4a-4df2-926d-9980e61d4c85 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d Jul 18 05:57:34 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Created reservations ['879a2168-864e-4698-8493-49c684b0979b', '06e5830a-5a55-4eb4-8983-352384a09c74', '41708900-789d-4666-9db8-54a7f8be37a0', 'b91b1857-9440-4177-88b0-2f2c6f94f1ee'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:34 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:34 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "cinder-d4d62887-17a1-49d7-b819-332e4cf67b6e-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-d4d62887-17a1-49d7-b819-332e4cf67b6e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "cinder-quobyte-d4d62887-17a1-49d7-b819-332e4cf67b6e" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-d4d62887-17a1-49d7-b819-332e4cf67b6e" acquired by "delete_volume" :: waited 0.029s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:35 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906665ac-5f4a-4df2-926d-9980e61d4c85 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d" returned: 0 in 0.483s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:35 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d is being set with open permissions: ugo+rw Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:35 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b560737-0bcf-4375-9758-2b12c28beb83]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c" returned: 0 in 0.612s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:35 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d Jul 18 05:57:35 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:35 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c Jul 18 05:57:35 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:35 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.402s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Deleted volume successfully. Jul 18 05:57:35 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e Jul 18 05:57:35 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-43ac373a-d363-4aac-9ef1-53b9db0cc0c6 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-6063c4f9-ae40-45d3-8e08-a2ae7b8581f3-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:35 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d" returned: 0 in 0.299s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:35 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.info Jul 18 05:57:35 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:35 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c" returned: 0 in 0.343s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Lock "cinder-quobyte-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c" released by "delete_volume" :: held 1.016s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:35 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e" returned: 0 in 0.419s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:35 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e Jul 18 05:57:35 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Created reservations ['85505ddf-e297-4ba7-856b-9ea8f56bf82e', '9616cb6a-a66e-4af3-a060-1587ae30dd71', '6278f75d-e5d4-474f-b933-0e0d03fb6573', 'd6ad48b8-9d9d-4383-9e4f-1f2e72bc048e'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:35 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:35 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:35 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.info" returned: 0 in 0.299s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:35 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.info is being set with open permissions: ugo+rw Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:35 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.info Jul 18 05:57:35 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:35 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-d4d62887-17a1-49d7-b819-332e4cf67b6e" returned: 0 in 0.293s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-quobyte-d4d62887-17a1-49d7-b819-332e4cf67b6e" released by "delete_volume" :: held 0.783s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Created reservations ['422ae028-eb03-4851-8c33-beddf6524eae', 'fd959f7e-bc54-47af-aec6-a2059fd9100e', '42d14534-9354-44ea-9822-a338036114ba', '254eccc2-7a35-4ad3-b722-93533ff3e689'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:35 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.299s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:35 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Deleted volume successfully. Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-329c1784-f751-4c21-9021-b7e3751aa43b tempest-ProjectReaderTests-1058351424 None] Lock "cinder-e7d4cafe-2cb2-4f0e-abb4-1c0a0b748d8c-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:36 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.info" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.199s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Creating offline snapshot 9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 of volume 8e742096-c9ff-4139-ad2f-619efa6a6e5a {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:57:36 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:36 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff060b-40c4-4968-b4dd-3cf89650d942]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:36 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-51bd59b7-a263-40f3-9111-75e2666eb94b tempest-CinderUnicodeTest-1842685695 None] Create snapshot completed successfully Jul 18 05:57:36 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a Jul 18 05:57:36 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:36 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Flow 'volume_create_manager' (6b44bdaf-d9c0-4bf9-b1fb-5e04d1d930a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5a8cb4-1dea-40f6-bce6-cbf4e099706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.384s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:36 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Deleted volume successfully. Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5a8cb4-1dea-40f6-bce6-cbf4e099706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677713837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0888da-7ac1-4d3d-88b9-4c11e5527fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e590c81504e8297ded44d8c42f830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:36Z,use_quota=True,user_id='a5f81262ff984832bf3fca8d420b22d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7ef4f6-3c9b-4693-ade5-0689a00b0533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7ef4f6-3c9b-4693-ade5-0689a00b0533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05152e1-7a8b-4c9b-9b58-b4403baeb9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05152e1-7a8b-4c9b-9b58-b4403baeb9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0888da-7ac1-4d3d-88b9-4c11e5527fd3', 'volume_name': 'volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372b1b75-3021-48dd-abd4-76bcdf7002f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372b1b75-3021-48dd-abd4-76bcdf7002f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a679dd7-c246-4e2a-8bb9-fb8a04522212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:36 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Volume ab0888da-7ac1-4d3d-88b9-4c11e5527fd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3', 'volume_size': 1} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd266056-4b10-41dc-89be-0d66546f7363 tempest-SnapshotDependencyTests-896249807 None] Lock "cinder-d4d62887-17a1-49d7-b819-332e4cf67b6e-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:36 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a" returned: 0 in 0.483s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:36 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 1G Jul 18 05:57:36 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "cinder-a9950a31-2167-4306-b197-c1954183323d-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-a9950a31-2167-4306-b197-c1954183323d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "cinder-quobyte-906665ac-5f4a-4df2-926d-9980e61d4c85" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-quobyte-906665ac-5f4a-4df2-926d-9980e61d4c85" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "cinder-quobyte-a9950a31-2167-4306-b197-c1954183323d" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-quobyte-a9950a31-2167-4306-b197-c1954183323d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Deleting offline snapshot a9950a31-2167-4306-b197-c1954183323d of volume 906665ac-5f4a-4df2-926d-9980e61d4c85 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] snapshot_file for this snap is: volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdecea4f-19ff-4f88-8ac0-d0ac4cfb064b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:36 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d Jul 18 05:57:36 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:37 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 1G" returned: 0 in 0.561s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:37 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 Jul 18 05:57:37 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:37 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d" returned: 0 in 0.475s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-906665ac-5f4a-4df2-926d-9980e61d4c85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9177373b-f522-4c8e-9cf1-29ea8bb9dd31]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:37 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 Jul 18 05:57:37 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:37 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5" returned: 0 in 0.311s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:37 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 is being set with open permissions: ugo+rw Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:37 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 Jul 18 05:57:37 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:37 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85" returned: 0 in 0.392s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:37 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5" returned: 0 in 0.254s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:37 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d Jul 18 05:57:37 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:37 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.info Jul 18 05:57:37 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:38 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.info" returned: 0 in 0.301s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:38 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.info is being set with open permissions: ugo+rw Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:38 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.info Jul 18 05:57:38 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:38 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d" returned: 0 in 0.414s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:38 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d Jul 18 05:57:38 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:38 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.info" returned: 0 in 0.263s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677713837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0888da-7ac1-4d3d-88b9-4c11e5527fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e590c81504e8297ded44d8c42f830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:36Z,use_quota=True,user_id='a5f81262ff984832bf3fca8d420b22d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Creating volume ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:38 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:38 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85.a9950a31-2167-4306-b197-c1954183323d" returned: 0 in 0.294s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:38 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 1073741824 Jul 18 05:57:38 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:38 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-384ecc11-afab-4d60-bb02-6574ea7a5b1c tempest-ProjectReaderTests-1494172448 None] Create snapshot completed successfully Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-quobyte-a9950a31-2167-4306-b197-c1954183323d" released by "_delete_snapshot" :: held 1.716s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-quobyte-906665ac-5f4a-4df2-926d-9980e61d4c85" released by "delete_snapshot" :: held 1.750s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Created reservations ['34cbb7bc-3e10-4ed2-9e4d-891966e1fdc0', '0e16ab27-8826-4fa9-8532-2cea4938560c', '069a2303-c33e-447e-9521-a957b0898310', '2f368af2-554c-4c1e-b732-405eb3041b16'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:38 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Delete snapshot completed successfully. Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cb7b1347-ba37-4bbb-8b9b-fa49ed7fbd90 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-a9950a31-2167-4306-b197-c1954183323d-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "cinder-906665ac-5f4a-4df2-926d-9980e61d4c85-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-906665ac-5f4a-4df2-926d-9980e61d4c85-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:38 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 1073741824" returned: 0 in 0.553s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "cinder-quobyte-906665ac-5f4a-4df2-926d-9980e61d4c85" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-quobyte-906665ac-5f4a-4df2-926d-9980e61d4c85" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7402f4dc-1ca0-4e99-bd99-0e23e0612df0]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:39 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 Jul 18 05:57:39 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-9413d1eb-3d19-4ae8-918c-fb8c9addbfc5-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-9413d1eb-3d19-4ae8-918c-fb8c9addbfc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-8e742096-c9ff-4139-ad2f-619efa6a6e5a" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-8e742096-c9ff-4139-ad2f-619efa6a6e5a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-9413d1eb-3d19-4ae8-918c-fb8c9addbfc5" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-9413d1eb-3d19-4ae8-918c-fb8c9addbfc5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Deleting offline snapshot 9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 of volume 8e742096-c9ff-4139-ad2f-619efa6a6e5a {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:57:39 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 Jul 18 05:57:39 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] snapshot_file for this snap is: volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fd47fd-d973-4316-80b7-a6a85c27b529]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:39 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3" returned: 0 in 0.375s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a679dd7-c246-4e2a-8bb9-fb8a04522212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9356d34-e325-432f-ab1e-d34045789612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:39 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Volume volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 (ab0888da-7ac1-4d3d-88b9-4c11e5527fd3): created successfully Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9356d34-e325-432f-ab1e-d34045789612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Flow 'volume_create_manager' (6b44bdaf-d9c0-4bf9-b1fb-5e04d1d930a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:39 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 Jul 18 05:57:39 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9180841c-328a-4ef8-9bd1-fe7a94a4dd44 tempest-ProjectReaderTests-1058351424 None] Created volume successfully. Jul 18 05:57:39 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85" returned: 0 in 0.612s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:39 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85 Jul 18 05:57:39 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:39 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5" returned: 0 in 0.496s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8a3800-dc3c-41cc-9d94-5d8d17c8b676]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:39 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a Jul 18 05:57:39 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:39 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-906665ac-5f4a-4df2-926d-9980e61d4c85" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-quobyte-906665ac-5f4a-4df2-926d-9980e61d4c85" released by "delete_volume" :: held 1.006s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Created reservations ['868c9398-f4e1-4064-99ee-969296c8ee51', '804f9820-2841-4fc1-abea-cb5bdf652d25', '1883bd15-26de-4fbc-8371-005d69a9b6ce', '20c4253f-8b30-44fa-a0f8-7481604b8f6e'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:40 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:40 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:40 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a" returned: 0 in 0.450s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:40 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 Jul 18 05:57:40 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:40 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.298s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:40 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Deleted volume successfully. Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dde4bc34-5ace-4184-af37-9843700ef246 tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-906665ac-5f4a-4df2-926d-9980e61d4c85-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:40 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5" returned: 0 in 0.424s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Acquiring lock "cinder-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:40 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5 Jul 18 05:57:40 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Lock "cinder-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Acquiring lock "cinder-quobyte-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Lock "cinder-quobyte-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f165754-a11e-40eb-adf1-dcca938807a9]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:40 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 Jul 18 05:57:40 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:41 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a.9413d1eb-3d19-4ae8-918c-fb8c9addbfc5" returned: 0 in 0.296s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-9413d1eb-3d19-4ae8-918c-fb8c9addbfc5" released by "_delete_snapshot" :: held 1.793s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-8e742096-c9ff-4139-ad2f-619efa6a6e5a" released by "delete_snapshot" :: held 1.826s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Created reservations ['455a3b53-5d7e-4e6c-87b7-ee8ff4648b1b', '7b1e2995-1832-4f9e-93d9-d969cf9097da', '5b88f96c-9ac1-42b6-84fe-234fcdef5f43', '8fd3c315-566c-4c82-b580-addaeb8ae26b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "cinder-47947fee-356b-4d9b-aca3-2a36cb4b01f0-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-47947fee-356b-4d9b-aca3-2a36cb4b01f0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "cinder-quobyte-47947fee-356b-4d9b-aca3-2a36cb4b01f0" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:41 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Delete snapshot completed successfully. Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-quobyte-47947fee-356b-4d9b-aca3-2a36cb4b01f0" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:41 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7c4a690c-8c64-43a3-b606-6746a5c2a4d7 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-9413d1eb-3d19-4ae8-918c-fb8c9addbfc5-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3" returned: 0 in 0.495s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c42906-1ff3-4520-ad8d-04c0543e8d9f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:41 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3 Jul 18 05:57:41 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-8e742096-c9ff-4139-ad2f-619efa6a6e5a-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Lock "cinder-8e742096-c9ff-4139-ad2f-619efa6a6e5a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-8e742096-c9ff-4139-ad2f-619efa6a6e5a" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:41 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 Jul 18 05:57:41 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-8e742096-c9ff-4139-ad2f-619efa6a6e5a" acquired by "delete_volume" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a426b-7401-4810-a767-84b136b2a090]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:41 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3" returned: 0 in 0.337s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:41 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a Jul 18 05:57:41 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Lock "cinder-quobyte-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3" released by "delete_volume" :: held 0.877s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Created reservations ['64abfd4d-53d2-4fbd-b50f-b27b84e4a53b', 'ccd3d75f-f1b2-436f-8856-bacb9ff6933c', '7c7a468d-953d-473c-9115-ca7d3f30bd52', '9e883758-378b-4cc0-83d3-00df7a22b10c'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:41 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0" returned: 0 in 0.421s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:41 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0 Jul 18 05:57:41 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:41 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:41 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:42 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a" returned: 0 in 0.490s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:42 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a Jul 18 05:57:42 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:42 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-47947fee-356b-4d9b-aca3-2a36cb4b01f0" returned: 0 in 0.463s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:42 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.364s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-quobyte-47947fee-356b-4d9b-aca3-2a36cb4b01f0" released by "delete_volume" :: held 0.955s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Deleted volume successfully. Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-04ab02b5-1f87-4a1d-9ace-451295ae006d tempest-ProjectReaderTests-1058351424 None] Lock "cinder-ab0888da-7ac1-4d3d-88b9-4c11e5527fd3-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Created reservations ['2bdd5b59-aeb0-4ddb-9dfe-7ac024080adc', '73f7e7f3-4ac9-4e91-8413-f4401d8206cc', '3947dc12-4795-4f50-b36d-3920869c346a', 'd6bfcd67-23b4-4d29-b3da-eb503a57fa12'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:42 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8e742096-c9ff-4139-ad2f-619efa6a6e5a" returned: 0 in 0.424s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-8e742096-c9ff-4139-ad2f-619efa6a6e5a" released by "delete_volume" :: held 0.981s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:42 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:42 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Flow 'volume_create_manager' (023097ae-e46b-4514-ac6e-434fbc6a7f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118f1b32-5383-4925-98b4-9661790bd8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Created reservations ['bc3b9297-2805-4e27-a1b1-e9cef42bd992', '000c9c3a-7d8e-4994-ad73-7bd080950ce1', '158aafd5-5517-4baa-b6cd-337c0a96440f', 'eb4c8a6c-28c8-46bb-9ff2-fcb986538b9a'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118f1b32-5383-4925-98b4-9661790bd8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063482174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8801d681-87a3-4358-9969-fe70502703c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e590c81504e8297ded44d8c42f830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:43Z,use_quota=True,user_id='a5f81262ff984832bf3fca8d420b22d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7677f8df-ae27-4506-8103-76dad31f6c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7677f8df-ae27-4506-8103-76dad31f6c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecaf790-5479-408f-b1f0-e9d250dd1e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecaf790-5479-408f-b1f0-e9d250dd1e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8801d681-87a3-4358-9969-fe70502703c6', 'volume_name': 'volume-8801d681-87a3-4358-9969-fe70502703c6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bda6018-4d09-41ae-a356-e052f68923a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bda6018-4d09-41ae-a356-e052f68923a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edd45a9-ed3c-49cc-9bd7-d1276a6f757a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:42 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Volume 8801d681-87a3-4358-9969-fe70502703c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8801d681-87a3-4358-9969-fe70502703c6', 'volume_size': 1} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063482174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8801d681-87a3-4358-9969-fe70502703c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e590c81504e8297ded44d8c42f830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:43Z,use_quota=True,user_id='a5f81262ff984832bf3fca8d420b22d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Creating volume 8801d681-87a3-4358-9969-fe70502703c6 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:42 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:42 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6 1073741824 Jul 18 05:57:42 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:42 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:42 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.313s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:42 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Deleted volume successfully. Jul 18 05:57:42 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3b3950aa-2a84-42d3-b147-cac215107aed tempest-CinderUnicodeTest-1842685695 None] Lock "cinder-47947fee-356b-4d9b-aca3-2a36cb4b01f0-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:43 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.345s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Deleted volume successfully. Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-2e0ff481-eeab-4f01-b242-e0f7bdfc880a tempest-ProjectReaderTests-1494172448 None] Lock "cinder-8e742096-c9ff-4139-ad2f-619efa6a6e5a-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:43 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6 1073741824" returned: 0 in 0.527s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:43 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6 Jul 18 05:57:43 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:43 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6" returned: 0 in 0.310s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edd45a9-ed3c-49cc-9bd7-d1276a6f757a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8801d681-87a3-4358-9969-fe70502703c6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa569aac-f1b3-4aff-969e-d2408ee2daa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:43 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Volume volume-8801d681-87a3-4358-9969-fe70502703c6 (8801d681-87a3-4358-9969-fe70502703c6): created successfully Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa569aac-f1b3-4aff-969e-d2408ee2daa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:43 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Flow 'volume_create_manager' (023097ae-e46b-4514-ac6e-434fbc6a7f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:43 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-23966a0a-0d92-49f7-94dc-19a9b26523d5 tempest-ProjectReaderTests-1058351424 None] Created volume successfully. Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (470d9d17-0d03-418e-b414-3948d1af4095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5869b0c4-ba45-4cd8-9851-444a40b44c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5869b0c4-ba45-4cd8-9851-444a40b44c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1679404232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61c11d3-ecc3-43a7-8b3b-474b19ca52a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:44Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c7904-e97b-4bdd-8e48-f384f8b38e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c7904-e97b-4bdd-8e48-f384f8b38e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e6a77d-27e3-49ae-b70c-57c3c0b8cf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e6a77d-27e3-49ae-b70c-57c3c0b8cf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61c11d3-ecc3-43a7-8b3b-474b19ca52a7', 'volume_name': 'volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed53c57-7347-4999-85ac-2d16b309d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed53c57-7347-4999-85ac-2d16b309d932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c975882a-05ef-444e-9124-95c699e9f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:44 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Volume f61c11d3-ecc3-43a7-8b3b-474b19ca52a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7', 'volume_size': 1} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1679404232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61c11d3-ecc3-43a7-8b3b-474b19ca52a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:44Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Creating volume f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:44 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:44 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 1073741824 Jul 18 05:57:44 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Acquiring lock "cinder-8801d681-87a3-4358-9969-fe70502703c6-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Lock "cinder-8801d681-87a3-4358-9969-fe70502703c6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Acquiring lock "cinder-quobyte-8801d681-87a3-4358-9969-fe70502703c6" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Lock "cinder-quobyte-8801d681-87a3-4358-9969-fe70502703c6" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac4979-3bc0-454d-8707-b68f058b671c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:45 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6 Jul 18 05:57:45 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:45 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 1073741824" returned: 0 in 0.739s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:45 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 Jul 18 05:57:45 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:45 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6" returned: 0 in 0.567s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:45 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6 Jul 18 05:57:45 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:45 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" returned: 0 in 0.341s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c975882a-05ef-444e-9124-95c699e9f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6a88bb-45c1-4366-a577-c51facb47044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:45 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Volume volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 (f61c11d3-ecc3-43a7-8b3b-474b19ca52a7): created successfully Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6a88bb-45c1-4366-a577-c51facb47044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (470d9d17-0d03-418e-b414-3948d1af4095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:45 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4ccabbd8-0216-44ad-ab7b-7e87f2ded1c0 tempest-ProjectReaderTests-1494172448 None] Created volume successfully. Jul 18 05:57:45 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8801d681-87a3-4358-9969-fe70502703c6" returned: 0 in 0.294s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Lock "cinder-quobyte-8801d681-87a3-4358-9969-fe70502703c6" released by "delete_volume" :: held 0.913s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:45 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Created reservations ['a909bc61-27bb-4bfa-8760-ace86e52b568', 'f1b52f45-e850-4b33-a9e0-807ed2197427', '4116b414-68d7-4f32-9115-d3de64836b8c', '21e041a2-3247-4bf3-94dd-a7ae7ed7898f'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:46 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:46 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:46 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.292s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Deleted volume successfully. Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-fa18d0c4-ffec-4513-ab79-8a5c89e8360e tempest-ProjectReaderTests-1058351424 None] Lock "cinder-8801d681-87a3-4358-9969-fe70502703c6-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Creating offline snapshot b36e0ae6-90d8-4f79-834a-740d59cce98f of volume f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37bb68d-5f6d-4e74-8dab-6a32a28a9b90]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:46 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 Jul 18 05:57:46 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:47 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" returned: 0 in 0.469s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:47 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f 1G Jul 18 05:57:47 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:47 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f 1G" returned: 0 in 0.512s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:47 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f Jul 18 05:57:47 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:48 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f" returned: 0 in 0.342s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:48 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f is being set with open permissions: ugo+rw Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:48 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f Jul 18 05:57:48 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:48 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f" returned: 0 in 0.292s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:48 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.info Jul 18 05:57:48 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:48 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.info" returned: 0 in 0.298s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:48 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.info is being set with open permissions: ugo+rw Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:48 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.info Jul 18 05:57:48 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (0bd7b796-76e7-402c-b3af-e5abf143f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d64278-8ee9-4b17-a39b-1317c35e219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d64278-8ee9-4b17-a39b-1317c35e219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-390583386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cae64b7-0ba3-4893-9c7d-587516f835d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:49Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081138c6-f249-4823-ba0a-dd355528955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081138c6-f249-4823-ba0a-dd355528955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c32f88b-96a1-4a15-95e9-db3b486a7111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c32f88b-96a1-4a15-95e9-db3b486a7111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cae64b7-0ba3-4893-9c7d-587516f835d4', 'volume_name': 'volume-9cae64b7-0ba3-4893-9c7d-587516f835d4', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f37a3ce-25e3-41aa-8e37-2b8145e00e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f37a3ce-25e3-41aa-8e37-2b8145e00e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ec62ac-c0cd-48d5-be64-67504546c573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:48 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Volume 9cae64b7-0ba3-4893-9c7d-587516f835d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cae64b7-0ba3-4893-9c7d-587516f835d4', 'volume_size': 1} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:48 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.info" returned: 0 in 0.273s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.105s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-390583386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cae64b7-0ba3-4893-9c7d-587516f835d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:49Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Creating volume 9cae64b7-0ba3-4893-9c7d-587516f835d4 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:49 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:49 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 1073741824 Jul 18 05:57:49 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:49 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9fb648e0-2426-4b62-a103-243a34d4bd8c tempest-ProjectReaderTests-1494172448 None] Create snapshot completed successfully Jul 18 05:57:49 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 1073741824" returned: 0 in 0.424s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:49 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 Jul 18 05:57:49 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:49 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4" returned: 0 in 0.257s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ec62ac-c0cd-48d5-be64-67504546c573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cae64b7-0ba3-4893-9c7d-587516f835d4', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13dcc49-5c4d-4d71-9ecf-bbb84c0aa3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:49 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Volume volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 (9cae64b7-0ba3-4893-9c7d-587516f835d4): created successfully Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13dcc49-5c4d-4d71-9ecf-bbb84c0aa3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (0bd7b796-76e7-402c-b3af-e5abf143f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:49 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-778ed106-d919-4890-91e2-0e35ee46da32 tempest-ProjectMemberTests-1121035528 None] Created volume successfully. Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-b36e0ae6-90d8-4f79-834a-740d59cce98f-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-b36e0ae6-90d8-4f79-834a-740d59cce98f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-b36e0ae6-90d8-4f79-834a-740d59cce98f" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-b36e0ae6-90d8-4f79-834a-740d59cce98f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Deleting offline snapshot b36e0ae6-90d8-4f79-834a-740d59cce98f of volume f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] snapshot_file for this snap is: volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b87ac-6140-4a70-b5a2-81b5dbbd8e91]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:50 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f Jul 18 05:57:50 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:50 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f" returned: 0 in 0.361s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:57:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a70d91a-f620-4b8c-8987-d9605e0076da]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:50 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 Jul 18 05:57:50 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:50 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" returned: 0 in 0.348s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:50 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f Jul 18 05:57:50 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:51 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f" returned: 0 in 0.366s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:51 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f Jul 18 05:57:51 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Creating offline snapshot cb62057b-9c14-4356-8ba0-9f6fb622548c of volume 9cae64b7-0ba3-4893-9c7d-587516f835d4 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b770b5-6d4c-43fc-bb58-4ed1567f15c2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:51 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7.b36e0ae6-90d8-4f79-834a-740d59cce98f" returned: 0 in 0.269s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:51 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-b36e0ae6-90d8-4f79-834a-740d59cce98f" released by "_delete_snapshot" :: held 1.433s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:51 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" released by "delete_snapshot" :: held 1.466s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Created reservations ['c8895aef-e849-4d78-a856-a230f7c9ef4c', '3a0bffb9-6d7c-4da8-9929-71eebd9de765', '3491cb12-62cc-405d-b173-8de78d274ca9', '7596de7b-504f-44ee-9456-bb1248f82aaf'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:51 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Delete snapshot completed successfully. Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-d29a70e2-886a-48e0-ace3-014b9a8649c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-b36e0ae6-90d8-4f79-834a-740d59cce98f-delete_snapshot" released by "delete_snapshot" :: held 1.604s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:51 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4" returned: 0 in 0.362s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:51 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c 1G Jul 18 05:57:51 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:52 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c 1G" returned: 0 in 0.409s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:52 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c Jul 18 05:57:52 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d20a3b6-9960-4d3d-a39e-076e4a47f011]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:52 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 Jul 18 05:57:52 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:52 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c" returned: 0 in 0.321s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:52 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c is being set with open permissions: ugo+rw Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:52 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c Jul 18 05:57:52 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:52 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" returned: 0 in 0.393s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:52 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7 Jul 18 05:57:52 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:52 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c" returned: 0 in 0.290s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:52 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.info Jul 18 05:57:52 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:52 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" returned: 0 in 0.265s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7" released by "delete_volume" :: held 0.714s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Created reservations ['559cf972-ffdb-40e7-86b6-896ed0f45921', '6e11076a-bb8e-421b-970b-adb7db4c5938', 'fb2f4955-e8c0-4b91-b720-957c567c41b2', 'f6e17857-baeb-4ed5-969e-48bf8b1c868f'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:52 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.info" returned: 0 in 0.262s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:52 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.info is being set with open permissions: ugo+rw Jul 18 05:57:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:52 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.info Jul 18 05:57:52 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:53 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:53 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:53 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.info" returned: 0 in 0.280s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.038s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a3c03dff-f058-4db8-b768-46fa3a8fba64 tempest-ProjectMemberTests-1121035528 None] Create snapshot completed successfully Jul 18 05:57:53 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.269s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Deleted volume successfully. Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-59933ccf-0e0c-40f5-82d1-2fd88c8b7091 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-f61c11d3-ecc3-43a7-8b3b-474b19ca52a7-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (99d0a2be-0416-46a4-8eae-802ce660db3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9b1303-1352-4e1e-953e-56ba4545ff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9b1303-1352-4e1e-953e-56ba4545ff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368875190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a309dc9-c832-48b3-bd35-a44426ad21df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:54Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8905f3b0-c076-4095-a52e-91609d5f857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8905f3b0-c076-4095-a52e-91609d5f857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dadcc1-eb1c-4bb8-950d-f58a63a2bae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dadcc1-eb1c-4bb8-950d-f58a63a2bae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a309dc9-c832-48b3-bd35-a44426ad21df', 'volume_name': 'volume-4a309dc9-c832-48b3-bd35-a44426ad21df', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5795576-d1e4-4ae9-b38b-17ed8cfae3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5795576-d1e4-4ae9-b38b-17ed8cfae3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb91525-8455-483b-b113-78d21d2c7a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:53 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Volume 4a309dc9-c832-48b3-bd35-a44426ad21df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a309dc9-c832-48b3-bd35-a44426ad21df', 'volume_size': 1} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368875190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a309dc9-c832-48b3-bd35-a44426ad21df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd992045ae4c3482361cb72b4e28a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:54Z,use_quota=True,user_id='19d52157bae641aab11dfd71c464527c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Creating volume 4a309dc9-c832-48b3-bd35-a44426ad21df {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:53 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:53 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df 1073741824 Jul 18 05:57:53 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:54 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df 1073741824" returned: 0 in 0.430s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:54 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df Jul 18 05:57:54 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-cb62057b-9c14-4356-8ba0-9f6fb622548c-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-cb62057b-9c14-4356-8ba0-9f6fb622548c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-9cae64b7-0ba3-4893-9c7d-587516f835d4" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-9cae64b7-0ba3-4893-9c7d-587516f835d4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-cb62057b-9c14-4356-8ba0-9f6fb622548c" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-cb62057b-9c14-4356-8ba0-9f6fb622548c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Deleting offline snapshot cb62057b-9c14-4356-8ba0-9f6fb622548c of volume 9cae64b7-0ba3-4893-9c7d-587516f835d4 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] snapshot_file for this snap is: volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd89440-b811-4591-ac63-380a18aa711c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:54 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df" returned: 0 in 0.268s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb91525-8455-483b-b113-78d21d2c7a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a309dc9-c832-48b3-bd35-a44426ad21df', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0152184b-c65d-4222-8959-72ee0d1bee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:54 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Volume volume-4a309dc9-c832-48b3-bd35-a44426ad21df (4a309dc9-c832-48b3-bd35-a44426ad21df): created successfully Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0152184b-c65d-4222-8959-72ee0d1bee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Flow 'volume_create_manager' (99d0a2be-0416-46a4-8eae-802ce660db3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:54 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e065c9de-2179-4ed2-a68c-116c82ec9f5e tempest-ProjectReaderTests-1494172448 None] Created volume successfully. Jul 18 05:57:54 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c Jul 18 05:57:54 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Creating offline snapshot 5def0411-19d8-4ba7-bb44-82f9db6ed62a of volume 4a309dc9-c832-48b3-bd35-a44426ad21df {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac8d69-ad8d-4168-9ec6-2b1395fbe9ec]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:54 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c" returned: 0 in 0.426s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cae64b7-0ba3-4893-9c7d-587516f835d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d544f736-f14b-4162-9318-c40540173660]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:55 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df Jul 18 05:57:55 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:55 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 Jul 18 05:57:55 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:55 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df" returned: 0 in 0.387s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:55 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a 1G Jul 18 05:57:55 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:55 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4" returned: 0 in 0.390s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:55 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c Jul 18 05:57:55 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:55 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a 1G" returned: 0 in 0.403s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a309dc9-c832-48b3-bd35-a44426ad21df -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:55 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:55 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a309dc9-c832-48b3-bd35-a44426ad21df -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a Jul 18 05:57:55 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c" returned: 0 in 0.375s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:55 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c Jul 18 05:57:55 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:55 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:55 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a309dc9-c832-48b3-bd35-a44426ad21df -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a" returned: 0 in 0.302s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:55 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a is being set with open permissions: ugo+rw Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4.cb62057b-9c14-4356-8ba0-9f6fb622548c" returned: 0 in 0.280s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:56 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a Jul 18 05:57:56 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-cb62057b-9c14-4356-8ba0-9f6fb622548c" released by "_delete_snapshot" :: held 1.592s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-9cae64b7-0ba3-4893-9c7d-587516f835d4" released by "delete_snapshot" :: held 1.618s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Created reservations ['c44fb1d8-fbbd-4b6c-9fb8-2a837a84470f', '7c007f3a-dbf0-440d-88e3-55f4fb06b87c', '73126b0e-ceba-482a-97a9-4d8e85b65e4a', '09db1e9b-dc26-479d-ac40-65f3d48a7f57'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Delete snapshot completed successfully. Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-4b013e90-006e-49e2-a6bc-979872cc4038 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-cb62057b-9c14-4356-8ba0-9f6fb622548c-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:56 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a" returned: 0 in 0.261s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:56 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.info Jul 18 05:57:56 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:56 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.info" returned: 0 in 0.267s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:56 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.info is being set with open permissions: ugo+rw Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-9cae64b7-0ba3-4893-9c7d-587516f835d4-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:56 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.info Jul 18 05:57:56 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-9cae64b7-0ba3-4893-9c7d-587516f835d4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-9cae64b7-0ba3-4893-9c7d-587516f835d4" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-9cae64b7-0ba3-4893-9c7d-587516f835d4" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bffb4b-b658-4e06-a208-5d1bedf264f2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:56 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 Jul 18 05:57:56 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:56 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.info" returned: 0 in 0.255s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:56 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2ee35a38-163c-4f77-aea0-94e964e1ed7f tempest-ProjectReaderTests-1494172448 None] Create snapshot completed successfully Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-5def0411-19d8-4ba7-bb44-82f9db6ed62a-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-5def0411-19d8-4ba7-bb44-82f9db6ed62a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:56 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-4a309dc9-c832-48b3-bd35-a44426ad21df" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-4a309dc9-c832-48b3-bd35-a44426ad21df" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-5def0411-19d8-4ba7-bb44-82f9db6ed62a" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-5def0411-19d8-4ba7-bb44-82f9db6ed62a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Deleting offline snapshot 5def0411-19d8-4ba7-bb44-82f9db6ed62a of volume 4a309dc9-c832-48b3-bd35-a44426ad21df {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] snapshot_file for this snap is: volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d6176a-ffc0-477e-accd-59d787d04225]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:57 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4" returned: 0 in 0.421s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:57 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4 Jul 18 05:57:57 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:57 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a Jul 18 05:57:57 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:57 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-9cae64b7-0ba3-4893-9c7d-587516f835d4" returned: 0 in 0.255s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-9cae64b7-0ba3-4893-9c7d-587516f835d4" released by "delete_volume" :: held 0.730s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Created reservations ['1df1da0d-abf8-4d26-ab63-dc06228c7919', '2a162322-8710-45f7-a20d-e98e481295c8', 'ff86d603-f56c-4b96-b74a-e54d19a0817a', 'a4a26c38-b2db-477c-ad2d-bd2ebb02831b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:57 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a" returned: 0 in 0.395s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a309dc9-c832-48b3-bd35-a44426ad21df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54402d2-a943-4a47-b4ea-874b9be0eb8b]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:57 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:57:57 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:57 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df Jul 18 05:57:57 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:57 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.251s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:57:57 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Deleted volume successfully. Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-19fbea77-e0ae-4254-8bcd-569c57e4ec15 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-9cae64b7-0ba3-4893-9c7d-587516f835d4-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:57 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df" returned: 0 in 0.391s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:57 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:57 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a Jul 18 05:57:57 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (17ffd0fe-fc88-4886-b27f-968d1db0424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b91664-bd1e-4e70-bc5f-caed1dab7cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b91664-bd1e-4e70-bc5f-caed1dab7cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681325945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef1f3e4-d0fb-43eb-af02-af567394a5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:58Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a0f511-a9d3-4588-9104-d1c1cf9fcb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a0f511-a9d3-4588-9104-d1c1cf9fcb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:58 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d3e0f0-be40-4fa8-9273-63d2c0e90b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d3e0f0-be40-4fa8-9273-63d2c0e90b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef1f3e4-d0fb-43eb-af02-af567394a5de', 'volume_name': 'volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6416d7df-d642-4f9c-9a7e-7a428e8153ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6416d7df-d642-4f9c-9a7e-7a428e8153ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e389c35a-2d96-4535-8f04-b541a043aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:58 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Volume 8ef1f3e4-d0fb-43eb-af02-af567394a5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de', 'volume_size': 1} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681325945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef1f3e4-d0fb-43eb-af02-af567394a5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:58Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Creating volume 8ef1f3e4-d0fb-43eb-af02-af567394a5de {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:58 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a" returned: 0 in 0.450s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:58 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de 1073741824 Jul 18 05:57:58 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:58 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a Jul 18 05:57:58 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:58 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df.5def0411-19d8-4ba7-bb44-82f9db6ed62a" returned: 0 in 0.251s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-5def0411-19d8-4ba7-bb44-82f9db6ed62a" released by "_delete_snapshot" :: held 1.579s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-4a309dc9-c832-48b3-bd35-a44426ad21df" released by "delete_snapshot" :: held 1.602s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Created reservations ['3ad12641-337f-4fdf-b849-1ebb2908643a', 'd64d5ea0-4e62-43e3-8213-6561b036a0e4', '441d1646-fc1b-4976-8644-a8673df1b034', 'fd76e784-57a9-4fad-be3f-f0e72334a70f'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:57:58 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Delete snapshot completed successfully. Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a5fc50cc-032b-41c3-9dbd-95336b8c32c1 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-5def0411-19d8-4ba7-bb44-82f9db6ed62a-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:58 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de 1073741824" returned: 0 in 0.451s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:58 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:58 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de Jul 18 05:57:58 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:59 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de" returned: 0 in 0.241s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e389c35a-2d96-4535-8f04-b541a043aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06080216-6ddf-4383-b4f0-61d53524585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:59 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Volume volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de (8ef1f3e4-d0fb-43eb-af02-af567394a5de): created successfully Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06080216-6ddf-4383-b4f0-61d53524585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (17ffd0fe-fc88-4886-b27f-968d1db0424e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:59 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-045f5482-be28-45b1-833c-c7ca4684f2bd tempest-ProjectMemberTests-1121035528 None] Created volume successfully. Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-4a309dc9-c832-48b3-bd35-a44426ad21df-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-4a309dc9-c832-48b3-bd35-a44426ad21df-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "cinder-quobyte-4a309dc9-c832-48b3-bd35-a44426ad21df" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-4a309dc9-c832-48b3-bd35-a44426ad21df" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b9cc37-c687-43d7-9ba6-55370b80fce5]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Creating offline snapshot f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 of volume 8ef1f3e4-d0fb-43eb-af02-af567394a5de {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:57:59 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df Jul 18 05:57:59 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d86806-650c-4495-a03e-d5416b8044ed]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:59 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de Jul 18 05:57:59 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:59 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df" returned: 0 in 0.369s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:59 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df Jul 18 05:57:59 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:59 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de" returned: 0 in 0.368s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:59 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 1G Jul 18 05:57:59 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:59 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4a309dc9-c832-48b3-bd35-a44426ad21df" returned: 0 in 0.245s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-quobyte-4a309dc9-c832-48b3-bd35-a44426ad21df" released by "delete_volume" :: held 0.678s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:57:59 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Created reservations ['e9c06e3c-3ec5-40ac-8450-5372123d0605', '9a43d4fa-e397-43f7-bc4e-9bfc3349b029', '9f8cb91c-37bb-4fd6-8710-01aa155e3e35', 'bde0db50-5ec2-4998-8c57-a2da9611b794'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:00 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:00 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:00 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 1G" returned: 0 in 0.427s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:00 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 Jul 18 05:58:00 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:00 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.279s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:00 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Deleted volume successfully. Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-8ebfed67-e01f-4b8e-8c87-b6c5ad155495 tempest-ProjectReaderTests-1494172448 None] Lock "cinder-4a309dc9-c832-48b3-bd35-a44426ad21df-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:00 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5" returned: 0 in 0.326s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:00 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 is being set with open permissions: ugo+rw Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:00 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 Jul 18 05:58:00 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:00 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5" returned: 0 in 0.253s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:00 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:00 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.info Jul 18 05:58:00 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:01 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.info" returned: 0 in 0.262s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:01 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.info is being set with open permissions: ugo+rw Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:01 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.info Jul 18 05:58:01 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:01 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.info" returned: 0 in 0.260s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:01 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-2566107b-a532-4fa5-82a5-5896f9991076 tempest-ProjectMemberTests-1121035528 None] Create snapshot completed successfully Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-f8e7a91a-0910-4808-adb4-3fbcde6cf2f5-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-f8e7a91a-0910-4808-adb4-3fbcde6cf2f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-8ef1f3e4-d0fb-43eb-af02-af567394a5de" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-8ef1f3e4-d0fb-43eb-af02-af567394a5de" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-f8e7a91a-0910-4808-adb4-3fbcde6cf2f5" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-f8e7a91a-0910-4808-adb4-3fbcde6cf2f5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Deleting offline snapshot f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 of volume 8ef1f3e4-d0fb-43eb-af02-af567394a5de {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] snapshot_file for this snap is: volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c24928d-89c8-48db-8647-973842ef6232]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:01 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 Jul 18 05:58:01 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:01 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5" returned: 0 in 0.410s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:01 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:58:02 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[452c7be7-17a9-4af3-bed4-3953c7f84441]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:02 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de Jul 18 05:58:02 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:02 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de" returned: 0 in 0.384s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:02 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 Jul 18 05:58:02 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:02 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5" returned: 0 in 0.350s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:02 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:02 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5 Jul 18 05:58:02 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:03 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de.f8e7a91a-0910-4808-adb4-3fbcde6cf2f5" returned: 0 in 0.251s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-f8e7a91a-0910-4808-adb4-3fbcde6cf2f5" released by "_delete_snapshot" :: held 1.515s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-8ef1f3e4-d0fb-43eb-af02-af567394a5de" released by "delete_snapshot" :: held 1.544s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Created reservations ['e2f5ddae-ec1d-438c-8a4a-96ea14196368', '87135f1c-4313-45d9-8af5-1b07f94158bc', '6fd8f445-c48c-42cc-8c2f-f040833d0111', '008ec961-08cd-49e0-ac93-a64ea508d9cf'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:03 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Delete snapshot completed successfully. Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-f22d8b2c-91af-44e4-a6c9-9e7bfc50092e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-f8e7a91a-0910-4808-adb4-3fbcde6cf2f5-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-8ef1f3e4-d0fb-43eb-af02-af567394a5de-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-8ef1f3e4-d0fb-43eb-af02-af567394a5de-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-8ef1f3e4-d0fb-43eb-af02-af567394a5de" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-8ef1f3e4-d0fb-43eb-af02-af567394a5de" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d028f6-8f02-4ad8-9fc5-f65ac6996b5f]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:03 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:03 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de Jul 18 05:58:03 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:04 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de" returned: 0 in 0.394s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:04 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de Jul 18 05:58:04 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:04 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-8ef1f3e4-d0fb-43eb-af02-af567394a5de" returned: 0 in 0.247s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-8ef1f3e4-d0fb-43eb-af02-af567394a5de" released by "delete_volume" :: held 0.708s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Created reservations ['08561afc-9141-42a3-b2bf-76e36f9a4bf6', '19a01030-9e10-4f34-8bd0-392439cd6f8b', '9165ff6d-702e-4b22-aa52-83e3403ad6d2', '845a3ce0-2ace-4681-a2b2-0e8a4b2b0556'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:04 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:04 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:04 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.248s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:04 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Deleted volume successfully. Jul 18 05:58:04 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-07db6383-223d-4926-a641-7713882205f1 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-8ef1f3e4-d0fb-43eb-af02-af567394a5de-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (9c875af0-280e-40e2-8892-4313dfbcf28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c03081-6c66-4665-b0aa-597f3542f9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c03081-6c66-4665-b0aa-597f3542f9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188972770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de24536d-0ef2-488a-9414-6b6597bf2b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:05Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c52cf4-22c4-465d-bd43-18c94b89ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c52cf4-22c4-465d-bd43-18c94b89ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03196fb-a19e-486c-a552-37831c0dfd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03196fb-a19e-486c-a552-37831c0dfd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de24536d-0ef2-488a-9414-6b6597bf2b19', 'volume_name': 'volume-de24536d-0ef2-488a-9414-6b6597bf2b19', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120b954a-6742-4d66-985c-f932a08d31b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120b954a-6742-4d66-985c-f932a08d31b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a4275e-4a14-46d1-b5f4-fa93953a258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:05 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Volume de24536d-0ef2-488a-9414-6b6597bf2b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de24536d-0ef2-488a-9414-6b6597bf2b19', 'volume_size': 1} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188972770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de24536d-0ef2-488a-9414-6b6597bf2b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:05Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Creating volume de24536d-0ef2-488a-9414-6b6597bf2b19 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:05 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:05 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 1073741824 Jul 18 05:58:05 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:05 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 1073741824" returned: 0 in 0.440s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:05 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:05 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 Jul 18 05:58:05 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:06 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19" returned: 0 in 0.254s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a4275e-4a14-46d1-b5f4-fa93953a258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de24536d-0ef2-488a-9414-6b6597bf2b19', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ba6503-ae36-4f79-8ed2-033437b007ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:06 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:06 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:06 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Volume volume-de24536d-0ef2-488a-9414-6b6597bf2b19 (de24536d-0ef2-488a-9414-6b6597bf2b19): created successfully Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ba6503-ae36-4f79-8ed2-033437b007ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (9c875af0-280e-40e2-8892-4313dfbcf28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:06 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-57a75163-6fad-4bc8-be76-180d093278a6 tempest-ProjectMemberTests-1121035528 None] Created volume successfully. Jul 18 05:58:06 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.279s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Creating offline snapshot 18c8c412-d63a-422f-8c39-ac2a0c3a92a3 of volume de24536d-0ef2-488a-9414-6b6597bf2b19 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d436e1-a58c-49a8-880e-d075b6eb4d94]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:06 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 Jul 18 05:58:06 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:06 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19" returned: 0 in 0.345s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:06 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 1G Jul 18 05:58:06 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:07 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 1G" returned: 0 in 0.384s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de24536d-0ef2-488a-9414-6b6597bf2b19 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:07 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de24536d-0ef2-488a-9414-6b6597bf2b19 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 Jul 18 05:58:07 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:07 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de24536d-0ef2-488a-9414-6b6597bf2b19 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3" returned: 0 in 0.321s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:07 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 is being set with open permissions: ugo+rw Jul 18 05:58:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:07 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 Jul 18 05:58:07 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:07 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3" returned: 0 in 0.250s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:07 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:07 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.info Jul 18 05:58:07 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:08 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.info" returned: 0 in 0.265s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:08 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.info is being set with open permissions: ugo+rw Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:08 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.info Jul 18 05:58:08 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:08 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.info" returned: 0 in 0.252s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:08 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-329d6d87-bdd4-43c9-bfa8-8daee001e06b tempest-ProjectMemberTests-1121035528 None] Create snapshot completed successfully Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-18c8c412-d63a-422f-8c39-ac2a0c3a92a3-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-18c8c412-d63a-422f-8c39-ac2a0c3a92a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-de24536d-0ef2-488a-9414-6b6597bf2b19" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-de24536d-0ef2-488a-9414-6b6597bf2b19" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-18c8c412-d63a-422f-8c39-ac2a0c3a92a3" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-18c8c412-d63a-422f-8c39-ac2a0c3a92a3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Deleting offline snapshot 18c8c412-d63a-422f-8c39-ac2a0c3a92a3 of volume de24536d-0ef2-488a-9414-6b6597bf2b19 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] snapshot_file for this snap is: volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca32fdd-83ee-4278-91d4-afab9016c9d4]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:08 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:08 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 Jul 18 05:58:08 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:09 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3" returned: 0 in 0.400s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:09 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de24536d-0ef2-488a-9414-6b6597bf2b19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:58:09 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd0d67c-5c13-44a1-b304-9194adb9f745]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:09 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 Jul 18 05:58:09 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:09 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19" returned: 0 in 0.381s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:09 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 Jul 18 05:58:09 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:09 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3" returned: 0 in 0.340s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:09 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:10 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3 Jul 18 05:58:10 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:10 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:10 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19.18c8c412-d63a-422f-8c39-ac2a0c3a92a3" returned: 0 in 0.257s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-18c8c412-d63a-422f-8c39-ac2a0c3a92a3" released by "_delete_snapshot" :: held 1.476s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-de24536d-0ef2-488a-9414-6b6597bf2b19" released by "delete_snapshot" :: held 1.501s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:10 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Created reservations ['40d235ec-d295-41a0-aef0-1a4ab375a8c6', '852f7851-9fb0-4c93-a933-9f49a361ca53', '231e7d84-6d52-4df8-a239-d47aad6e3433', 'b7f37e1d-f459-47e9-9f62-68fefd5a057d'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:10 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Delete snapshot completed successfully. Jul 18 05:58:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-15078708-8144-4819-b720-d3f451353ed3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-18c8c412-d63a-422f-8c39-ac2a0c3a92a3-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-de24536d-0ef2-488a-9414-6b6597bf2b19-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-de24536d-0ef2-488a-9414-6b6597bf2b19-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-de24536d-0ef2-488a-9414-6b6597bf2b19" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:10 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-de24536d-0ef2-488a-9414-6b6597bf2b19" acquired by "delete_volume" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[991eab60-d429-486a-89c5-37c73c2ac03e]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:11 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 Jul 18 05:58:11 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:11 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19" returned: 0 in 0.400s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:11 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19 Jul 18 05:58:11 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Flow 'volume_create_manager' (a1679a09-62c2-45f7-aaba-6ca85885ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6990bf2c-83fc-42cc-aa45-0d4797756b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6990bf2c-83fc-42cc-aa45-0d4797756b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977940704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfa6bca-4897-4701-8dbc-9909f196de24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8e97d619ad4dd5b1ac33fb61096076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:11Z,use_quota=True,user_id='066751a5ea244faa8d0adaef6e907771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935d4301-59cf-4ef6-81ca-9d8cc2ac0592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935d4301-59cf-4ef6-81ca-9d8cc2ac0592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7b7886-83cc-4e75-a8f9-18b67fd60166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7b7886-83cc-4e75-a8f9-18b67fd60166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bfa6bca-4897-4701-8dbc-9909f196de24', 'volume_name': 'volume-6bfa6bca-4897-4701-8dbc-9909f196de24', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2766bae-dc59-41e7-903a-d459d0386bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2766bae-dc59-41e7-903a-d459d0386bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564023fd-e6a5-46fb-b13a-aa4d0cf1af1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:11 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Volume 6bfa6bca-4897-4701-8dbc-9909f196de24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bfa6bca-4897-4701-8dbc-9909f196de24', 'volume_size': 1} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977940704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfa6bca-4897-4701-8dbc-9909f196de24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8e97d619ad4dd5b1ac33fb61096076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:11Z,use_quota=True,user_id='066751a5ea244faa8d0adaef6e907771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Creating volume 6bfa6bca-4897-4701-8dbc-9909f196de24 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:11 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:11 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24 1073741824 Jul 18 05:58:11 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:11 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-de24536d-0ef2-488a-9414-6b6597bf2b19" returned: 0 in 0.265s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-de24536d-0ef2-488a-9414-6b6597bf2b19" released by "delete_volume" :: held 0.729s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Created reservations ['2a2ffb31-3729-40b5-b6b7-3fe770b83d8f', '19305fa9-5fa6-4497-8b52-290e9220aa34', 'f41d4a6d-fc4d-4f48-97e1-2609c44f3c2a', '8799e951-d5cd-44ef-a578-c724da3247b0'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:11 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:11 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:11 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:11 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24 1073741824" returned: 0 in 0.449s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:12 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24 Jul 18 05:58:12 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:12 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.307s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:12 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Deleted volume successfully. Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0683978c-0474-4f5b-97b4-ecf58acdfd79 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-de24536d-0ef2-488a-9414-6b6597bf2b19-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:12 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24" returned: 0 in 0.262s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564023fd-e6a5-46fb-b13a-aa4d0cf1af1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bfa6bca-4897-4701-8dbc-9909f196de24', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf466122-89ad-4deb-a7f2-a9a158083bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:12 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Volume volume-6bfa6bca-4897-4701-8dbc-9909f196de24 (6bfa6bca-4897-4701-8dbc-9909f196de24): created successfully Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf466122-89ad-4deb-a7f2-a9a158083bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Flow 'volume_create_manager' (a1679a09-62c2-45f7-aaba-6ca85885ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:12 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4e823250-fd1b-471f-864b-45882b3cd0a2 tempest-ProjectReaderTests-758874038 None] Created volume successfully. Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (b7a76cdc-cb64-45c1-817e-c5e30179bcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121298c-df07-4858-9a74-7d4acea67816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2121298c-df07-4858-9a74-7d4acea67816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687158247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72661f8b-f3e7-488f-b714-ae73f0b8a6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:13Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dc3f88-f928-40da-9e27-e2fa4fc85d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dc3f88-f928-40da-9e27-e2fa4fc85d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c694300-fd13-4de3-880c-f31bcf8c93c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c694300-fd13-4de3-880c-f31bcf8c93c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72661f8b-f3e7-488f-b714-ae73f0b8a6c6', 'volume_name': 'volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c082b5-001c-411e-a521-8064d625634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c082b5-001c-411e-a521-8064d625634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4886b920-0c43-4f6b-afed-e73081910ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:12 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Volume 72661f8b-f3e7-488f-b714-ae73f0b8a6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6', 'volume_size': 1} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687158247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72661f8b-f3e7-488f-b714-ae73f0b8a6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:13Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Creating volume 72661f8b-f3e7-488f-b714-ae73f0b8a6c6 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:12 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:58:12 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:12 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 1073741824 Jul 18 05:58:12 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:13 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 1073741824" returned: 0 in 0.405s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:13 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 Jul 18 05:58:13 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:13 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" returned: 0 in 0.238s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4886b920-0c43-4f6b-afed-e73081910ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e155845-3ce2-4dce-935a-3c738235b74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:13 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Volume volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 (72661f8b-f3e7-488f-b714-ae73f0b8a6c6): created successfully Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e155845-3ce2-4dce-935a-3c738235b74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (b7a76cdc-cb64-45c1-817e-c5e30179bcb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:13 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-cdaf546e-9571-492c-b06c-ffede7b98204 tempest-ProjectMemberTests-1121035528 None] Created volume successfully. Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Acquiring lock "cinder-6bfa6bca-4897-4701-8dbc-9909f196de24-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Lock "cinder-6bfa6bca-4897-4701-8dbc-9909f196de24-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Creating offline snapshot 16523060-03b6-495a-87e0-7bbffb371637 of volume 72661f8b-f3e7-488f-b714-ae73f0b8a6c6 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Acquiring lock "cinder-quobyte-6bfa6bca-4897-4701-8dbc-9909f196de24" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Lock "cinder-quobyte-6bfa6bca-4897-4701-8dbc-9909f196de24" acquired by "delete_volume" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db1a1ef-bc8c-48de-9bab-3855cb1a6dcf]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef941fb-986e-4ee6-b716-2b2c256d9b72]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:13 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:13 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 Jul 18 05:58:13 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:13 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24 Jul 18 05:58:13 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:14 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" returned: 0 in 0.377s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:14 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24" returned: 0 in 0.386s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:14 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 1G Jul 18 05:58:14 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:14 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24 Jul 18 05:58:14 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:14 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-6bfa6bca-4897-4701-8dbc-9909f196de24" returned: 0 in 0.291s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Lock "cinder-quobyte-6bfa6bca-4897-4701-8dbc-9909f196de24" released by "delete_volume" :: held 0.718s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=198,cinder:INSERT=68,cinder:UPDATE=237,cinder:DELETE=17 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=178,cinder:INSERT=59,cinder:UPDATE=254,cinder:DELETE=25 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Created reservations ['06aa6df5-ae75-427d-acd0-16a88bb22a7c', '3c051c1f-d0fc-4b80-b495-60474d3fa4d0', 'fbcfe729-a212-4c86-ac3c-25bedf3f2932', '4e5383ca-c8cf-46f3-bd7e-6b106626413a'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:14 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 1G" returned: 0 in 0.482s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:14 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:14 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:14 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 Jul 18 05:58:14 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:14 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.264s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:14 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Deleted volume successfully. Jul 18 05:58:14 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-cf5a7178-35f9-4ca1-9065-7b7e18370a04 tempest-ProjectReaderTests-758874038 None] Lock "cinder-6bfa6bca-4897-4701-8dbc-9909f196de24-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:15 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637" returned: 0 in 0.323s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:15 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 is being set with open permissions: ugo+rw Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:15 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 Jul 18 05:58:15 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:15 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637" returned: 0 in 0.264s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:15 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.info Jul 18 05:58:15 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Flow 'volume_create_manager' (03edc6cf-89f0-4ab5-99c0-f3d72526d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230f7a8f-c07a-4446-9e7a-25cddb93b04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230f7a8f-c07a-4446-9e7a-25cddb93b04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1605076679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfce2bbc-6763-4092-af94-7406f2015cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8e97d619ad4dd5b1ac33fb61096076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:15Z,use_quota=True,user_id='066751a5ea244faa8d0adaef6e907771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e25db8-de5a-4747-87fe-05e800126cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e25db8-de5a-4747-87fe-05e800126cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c72661d-de58-4da0-8525-15f0bff89e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c72661d-de58-4da0-8525-15f0bff89e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfce2bbc-6763-4092-af94-7406f2015cdf', 'volume_name': 'volume-dfce2bbc-6763-4092-af94-7406f2015cdf', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c0620e-2078-49e0-bdea-d0b849341d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c0620e-2078-49e0-bdea-d0b849341d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc31b38e-ec47-4ebd-b6d6-d17fced3e515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:15 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Volume dfce2bbc-6763-4092-af94-7406f2015cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfce2bbc-6763-4092-af94-7406f2015cdf', 'volume_size': 1} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:15 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.info" returned: 0 in 0.257s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:15 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.info is being set with open permissions: ugo+rw Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:15 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.info Jul 18 05:58:15 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:15 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.info" returned: 0 in 0.235s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1605076679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfce2bbc-6763-4092-af94-7406f2015cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8e97d619ad4dd5b1ac33fb61096076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:15Z,use_quota=True,user_id='066751a5ea244faa8d0adaef6e907771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Creating volume dfce2bbc-6763-4092-af94-7406f2015cdf {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:15 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:58:15 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:15 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf 1073741824 Jul 18 05:58:15 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:15 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e1f922f2-3db0-4aef-a738-5cd605915e47 tempest-ProjectMemberTests-1121035528 None] Create snapshot completed successfully Jul 18 05:58:16 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf 1073741824" returned: 0 in 0.402s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:16 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf Jul 18 05:58:16 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:16 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf" returned: 0 in 0.249s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc31b38e-ec47-4ebd-b6d6-d17fced3e515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfce2bbc-6763-4092-af94-7406f2015cdf', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bee325-2d2c-4f1b-92ae-bd604afdcba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:16 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Volume volume-dfce2bbc-6763-4092-af94-7406f2015cdf (dfce2bbc-6763-4092-af94-7406f2015cdf): created successfully Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bee325-2d2c-4f1b-92ae-bd604afdcba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Flow 'volume_create_manager' (03edc6cf-89f0-4ab5-99c0-f3d72526d665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:16 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a4d13b66-b520-4a3c-b031-1357ed2a7e11 tempest-ProjectReaderTests-758874038 None] Created volume successfully. Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-16523060-03b6-495a-87e0-7bbffb371637-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Lock "cinder-16523060-03b6-495a-87e0-7bbffb371637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-16523060-03b6-495a-87e0-7bbffb371637" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-16523060-03b6-495a-87e0-7bbffb371637" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Deleting offline snapshot 16523060-03b6-495a-87e0-7bbffb371637 of volume 72661f8b-f3e7-488f-b714-ae73f0b8a6c6 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] snapshot_file for this snap is: volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3601dc6-d6dc-4ff6-92bc-8393575ec004]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:16 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:17 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 Jul 18 05:58:17 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:17 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637" returned: 0 in 0.359s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[812f3e0d-c188-43d8-beaf-b7714cdc193c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Acquiring lock "cinder-dfce2bbc-6763-4092-af94-7406f2015cdf-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Lock "cinder-dfce2bbc-6763-4092-af94-7406f2015cdf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:17 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 Jul 18 05:58:17 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Acquiring lock "cinder-quobyte-dfce2bbc-6763-4092-af94-7406f2015cdf" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Lock "cinder-quobyte-dfce2bbc-6763-4092-af94-7406f2015cdf" acquired by "delete_volume" :: waited 0.024s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[095d21e6-b59d-4d29-a556-a76a39553a68]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:17 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf Jul 18 05:58:17 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:17 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" returned: 0 in 0.377s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:17 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 Jul 18 05:58:17 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:17 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf" returned: 0 in 0.375s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:17 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:17 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf Jul 18 05:58:17 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:18 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637" returned: 0 in 0.350s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:18 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637 Jul 18 05:58:18 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:18 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-dfce2bbc-6763-4092-af94-7406f2015cdf" returned: 0 in 0.270s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Lock "cinder-quobyte-dfce2bbc-6763-4092-af94-7406f2015cdf" released by "delete_volume" :: held 0.697s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Created reservations ['94a3742d-e2e4-43e4-bbbc-892152fa3fff', '8b070284-b59f-47e0-ab9e-16511fa7c533', '7a7e8909-fb3d-4aee-9b2f-437ddcf1a509', 'aa54d382-81d2-4fe4-ae62-5da0c1e8987a'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:18 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6.16523060-03b6-495a-87e0-7bbffb371637" returned: 0 in 0.267s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:18 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:18 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-16523060-03b6-495a-87e0-7bbffb371637" released by "_delete_snapshot" :: held 1.459s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" released by "delete_snapshot" :: held 1.481s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Created reservations ['ab3da19a-05b2-4f4f-b6bb-7f6440df083d', '0992c4a5-3c6b-46ea-8ebb-2b871673b1ab', '0cba5e0e-bd56-4617-a27d-4a49a731803a', 'ec6b1833-5a93-4dc7-acf5-2ca2ea7c7bf5'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Delete snapshot completed successfully. Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dbd33234-4163-4031-9afb-4b443ec914ad tempest-ProjectMemberTests-1121035528 None] Lock "cinder-16523060-03b6-495a-87e0-7bbffb371637-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:18 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.289s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:18 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Deleted volume successfully. Jul 18 05:58:18 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-61e5d35a-c6a3-4e6d-adc1-caea82a9e784 tempest-ProjectReaderTests-758874038 None] Lock "cinder-dfce2bbc-6763-4092-af94-7406f2015cdf-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-72661f8b-f3e7-488f-b714-ae73f0b8a6c6-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Lock "cinder-72661f8b-f3e7-488f-b714-ae73f0b8a6c6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" acquired by "delete_volume" :: waited 0.018s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f68fda-92a3-4581-9bb0-740424381852]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:19 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 Jul 18 05:58:19 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:19 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" returned: 0 in 0.399s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:19 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6 Jul 18 05:58:19 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:19 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" returned: 0 in 0.280s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:19 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-72661f8b-f3e7-488f-b714-ae73f0b8a6c6" released by "delete_volume" :: held 0.752s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Created reservations ['151f8518-cd8a-44e0-8881-1ef0c1c88b89', 'dbceaf35-4407-4197-9e14-4858799c7d24', '84b452a2-30a7-4690-9bcd-ba65227d321c', 'df384438-5cbb-45b2-80e0-25c0b339867a'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:20 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:20 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:20 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:20 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Deleted volume successfully. Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-3a5ce6b6-e5ff-486c-9a8f-1a9adc76bcbd tempest-ProjectMemberTests-1121035528 None] Lock "cinder-72661f8b-f3e7-488f-b714-ae73f0b8a6c6-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (d9f6b33a-3a87-47fa-922a-e2f4345cc3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba04bc2-4fc7-403b-b47a-bb97c0ac6749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba04bc2-4fc7-403b-b47a-bb97c0ac6749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879661055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4470ce5a-f239-4d0b-a4f3-4b6e9a16f369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:21Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95cfde1-d374-4edd-8566-1406b6cb7b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95cfde1-d374-4edd-8566-1406b6cb7b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf98b6e-a6e4-45ed-88b8-c1947ac24f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf98b6e-a6e4-45ed-88b8-c1947ac24f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4470ce5a-f239-4d0b-a4f3-4b6e9a16f369', 'volume_name': 'volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f095c6-dd28-42b0-bff6-916ea49da420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f095c6-dd28-42b0-bff6-916ea49da420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886bda2f-dedc-4820-bea4-b632fd28d6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Volume 4470ce5a-f239-4d0b-a4f3-4b6e9a16f369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369', 'volume_size': 1} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879661055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4470ce5a-f239-4d0b-a4f3-4b6e9a16f369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:21Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Creating volume 4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:20 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:58:20 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:20 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 1073741824 Jul 18 05:58:20 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:21 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 1073741824" returned: 0 in 0.402s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:21 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 Jul 18 05:58:21 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:21 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886bda2f-dedc-4820-bea4-b632fd28d6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a223aa75-cf11-4241-ac31-582d5e33c742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:21 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Volume volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 (4470ce5a-f239-4d0b-a4f3-4b6e9a16f369): created successfully Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a223aa75-cf11-4241-ac31-582d5e33c742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (d9f6b33a-3a87-47fa-922a-e2f4345cc3fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:21 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-e06f6e48-be76-4592-9b8f-69e47c142a38 tempest-ProjectMemberTests-1121035528 None] Created volume successfully. Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Creating offline snapshot 659326ca-225b-431d-b377-021f58732c0f of volume 4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd92b41-d115-4513-a576-584a448ac363]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:21 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:22 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 Jul 18 05:58:22 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:22 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" returned: 0 in 0.362s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:22 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f 1G Jul 18 05:58:22 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:22 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f 1G" returned: 0 in 0.371s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:22 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:22 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f Jul 18 05:58:22 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:23 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f" returned: 0 in 0.304s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:23 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f is being set with open permissions: ugo+rw Jul 18 05:58:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:23 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f Jul 18 05:58:23 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:23 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f" returned: 0 in 0.237s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:23 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.info Jul 18 05:58:23 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:23 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.info" returned: 0 in 0.239s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:23 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.info is being set with open permissions: ugo+rw Jul 18 05:58:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:23 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.info Jul 18 05:58:23 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:23 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.info" returned: 0 in 0.239s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:23 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:23 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-446fdec2-be8d-42e6-a4ff-f2a9b53283db tempest-ProjectMemberTests-1121035528 None] Create snapshot completed successfully Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-659326ca-225b-431d-b377-021f58732c0f-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-659326ca-225b-431d-b377-021f58732c0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-659326ca-225b-431d-b377-021f58732c0f" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-659326ca-225b-431d-b377-021f58732c0f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Deleting offline snapshot 659326ca-225b-431d-b377-021f58732c0f of volume 4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] snapshot_file for this snap is: volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ccd775-bc3d-480f-87b1-4111f55672a1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:24 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f Jul 18 05:58:24 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:24 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f" returned: 0 in 0.358s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[726632f8-9e55-47ca-b61e-3415338bdee5]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:24 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 Jul 18 05:58:24 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:24 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" returned: 0 in 0.345s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:24 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:24 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f Jul 18 05:58:24 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:25 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f" returned: 0 in 0.328s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:25 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f Jul 18 05:58:25 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:25 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:25 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369.659326ca-225b-431d-b377-021f58732c0f" returned: 0 in 0.238s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-659326ca-225b-431d-b377-021f58732c0f" released by "_delete_snapshot" :: held 1.361s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" released by "delete_snapshot" :: held 1.381s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:25 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Created reservations ['befcaaca-4074-4a97-972c-f8728085a127', '5cf529b0-8960-445e-a93e-c83e18c4d004', '180d6f87-7ec6-4e55-b52a-4952176d3ddd', 'd2f4ec48-d940-4af6-91be-9c9d9141637f'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:25 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Delete snapshot completed successfully. Jul 18 05:58:25 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-787ce739-448b-4ea0-bd68-14f758121ac4 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-659326ca-225b-431d-b377-021f58732c0f-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Lock "cinder-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" acquired by "delete_volume" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9289faea-6154-43e4-947d-f71ba211632a]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:26 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 Jul 18 05:58:26 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:26 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" returned: 0 in 0.348s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:26 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369 Jul 18 05:58:26 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:26 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" returned: 0 in 0.238s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369" released by "delete_volume" :: held 0.641s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:26 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Created reservations ['e8e7c267-dab5-40a5-9f62-a918489934f5', 'eebdd290-1421-4211-9586-7eec5b9d1e8b', '5c191fce-bdd7-416b-9781-e0d7fdb27cbf', '2761ea1d-85cb-483e-a1f0-dd411ba88b45'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:27 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:27 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:27 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.246s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:27 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Deleted volume successfully. Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c1ffd071-65c9-41ba-9bf4-8f8bd7249dac tempest-ProjectMemberTests-1121035528 None] Lock "cinder-4470ce5a-f239-4d0b-a4f3-4b6e9a16f369-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (0119b484-5b3f-4e66-92e4-3497ae75541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a3c2ce-2408-4615-a7bc-ba1cf21a5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a3c2ce-2408-4615-a7bc-ba1cf21a5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781314032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3374dd-d703-4f8c-b9b2-50e3a29ec54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:28Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26a6228-42f6-4648-ac25-b5c51375d0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26a6228-42f6-4648-ac25-b5c51375d0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6486486-0135-4444-b543-ea52b3d7906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6486486-0135-4444-b543-ea52b3d7906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3374dd-d703-4f8c-b9b2-50e3a29ec54d', 'volume_name': 'volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aae34c-774b-4231-b262-bfc91186eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aae34c-774b-4231-b262-bfc91186eaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc09808d-5e51-4780-859c-d6db9ce54f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:27 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Volume 7c3374dd-d703-4f8c-b9b2-50e3a29ec54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d', 'volume_size': 1} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781314032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3374dd-d703-4f8c-b9b2-50e3a29ec54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:28Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Creating volume 7c3374dd-d703-4f8c-b9b2-50e3a29ec54d {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:27 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:58:27 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:27 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d 1073741824 Jul 18 05:58:27 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:28 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d 1073741824" returned: 0 in 0.399s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:28 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d Jul 18 05:58:28 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:28 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" returned: 0 in 0.239s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc09808d-5e51-4780-859c-d6db9ce54f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda856ef-eb56-4c86-b333-9f1c74eac8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:28 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Volume volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d (7c3374dd-d703-4f8c-b9b2-50e3a29ec54d): created successfully Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda856ef-eb56-4c86-b333-9f1c74eac8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (0119b484-5b3f-4e66-92e4-3497ae75541b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:28 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-8d157124-834a-4818-bdf5-6f21f4b46ec1 tempest-ProjectMemberTests-1121035528 None] Created volume successfully. Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Creating offline snapshot de734e02-ede2-48e1-84e9-a3d92e9b9889 of volume 7c3374dd-d703-4f8c-b9b2-50e3a29ec54d {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0bb655-f96d-4361-8a59-2a6e6108bc4c]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:28 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:29 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d Jul 18 05:58:29 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:29 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" returned: 0 in 0.362s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:29 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 1G Jul 18 05:58:29 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:29 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 1G" returned: 0 in 0.377s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:29 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:29 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 Jul 18 05:58:29 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:30 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889" returned: 0 in 0.294s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:30 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 is being set with open permissions: ugo+rw Jul 18 05:58:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:30 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 Jul 18 05:58:30 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:30 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889" returned: 0 in 0.245s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:30 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.info Jul 18 05:58:30 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:30 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.info" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:30 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.info is being set with open permissions: ugo+rw Jul 18 05:58:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:30 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.info Jul 18 05:58:30 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:30 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.info" returned: 0 in 0.236s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:30 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:30 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7bdb1aa7-82ec-4e13-b326-f02869e5a42e tempest-ProjectMemberTests-1121035528 None] Create snapshot completed successfully Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-de734e02-ede2-48e1-84e9-a3d92e9b9889-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-de734e02-ede2-48e1-84e9-a3d92e9b9889-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-de734e02-ede2-48e1-84e9-a3d92e9b9889" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-de734e02-ede2-48e1-84e9-a3d92e9b9889" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Deleting offline snapshot de734e02-ede2-48e1-84e9-a3d92e9b9889 of volume 7c3374dd-d703-4f8c-b9b2-50e3a29ec54d {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] snapshot_file for this snap is: volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a057f947-4dc6-4a68-a9a5-bba6d09f6ed1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:31 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 Jul 18 05:58:31 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:31 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889" returned: 0 in 0.364s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e703a5-6a40-405d-a0e5-46c08739bbb1]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:31 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d Jul 18 05:58:31 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:31 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" returned: 0 in 0.340s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:31 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:31 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 Jul 18 05:58:31 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:32 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889" returned: 0 in 0.322s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:32 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889 Jul 18 05:58:32 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:32 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:32 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d.de734e02-ede2-48e1-84e9-a3d92e9b9889" returned: 0 in 0.239s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-de734e02-ede2-48e1-84e9-a3d92e9b9889" released by "_delete_snapshot" :: held 1.359s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" released by "delete_snapshot" :: held 1.384s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:32 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Created reservations ['eea5d2fc-1718-4d46-9991-930a6fdf325d', '7e4d0622-9c30-4be5-9c43-2508434dac39', '42787727-5171-4cd9-8e88-c7e068ffe19a', '41adfd0e-9b84-4d8a-8fd4-8fc2ebe642c9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:32 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Delete snapshot completed successfully. Jul 18 05:58:32 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-14933e94-520a-4bb9-89b7-f32eff9cd198 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-de734e02-ede2-48e1-84e9-a3d92e9b9889-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6636db-5d07-437a-896b-a2acba4e5418]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:33 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d Jul 18 05:58:33 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:33 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" returned: 0 in 0.359s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:33 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d Jul 18 05:58:33 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:33 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" returned: 0 in 0.245s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:33 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d" released by "delete_volume" :: held 0.660s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Created reservations ['b7889141-f81e-41f5-b35d-5bfc08be98d9', '8e6882e1-08af-4d68-bfab-0dcec8a66af0', 'faa021b9-b263-432d-98e3-b5ea4fc454be', '52929285-ffd9-4bb5-b491-77a85ff2db25'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:34 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:34 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:34 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.256s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:34 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Deleted volume successfully. Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0524cf0e-7084-4cca-a944-b2955b7bee89 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-7c3374dd-d703-4f8c-b9b2-50e3a29ec54d-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (3aae06f8-3ace-4e49-b6bd-aa9576c52542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325892c6-2adb-4200-8fe3-1414fcd2ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325892c6-2adb-4200-8fe3-1414fcd2ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1391452078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a59302-a5fd-4fe3-85cf-0417b104e981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:35Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99d03ca-6e3b-4d4b-8d25-b72e1ffb2bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99d03ca-6e3b-4d4b-8d25-b72e1ffb2bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83eb743f-56f4-43b3-b321-c68ba3dc78ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83eb743f-56f4-43b3-b321-c68ba3dc78ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a59302-a5fd-4fe3-85cf-0417b104e981', 'volume_name': 'volume-51a59302-a5fd-4fe3-85cf-0417b104e981', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c3e602-e223-4d7d-8b54-3b2a05ffaada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c3e602-e223-4d7d-8b54-3b2a05ffaada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf51fbba-09a5-40c3-a25e-6036f0791aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:34 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Volume 51a59302-a5fd-4fe3-85cf-0417b104e981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a59302-a5fd-4fe3-85cf-0417b104e981', 'volume_size': 1} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1391452078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a59302-a5fd-4fe3-85cf-0417b104e981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:35Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Creating volume 51a59302-a5fd-4fe3-85cf-0417b104e981 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:34 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:58:34 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:35 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 1073741824 Jul 18 05:58:35 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:35 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 1073741824" returned: 0 in 0.410s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:35 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 Jul 18 05:58:35 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:35 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981" returned: 0 in 0.238s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:35 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:35 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf51fbba-09a5-40c3-a25e-6036f0791aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a59302-a5fd-4fe3-85cf-0417b104e981', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fafac0-0e3e-464c-8a96-e9dca923a1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:35 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Volume volume-51a59302-a5fd-4fe3-85cf-0417b104e981 (51a59302-a5fd-4fe3-85cf-0417b104e981): created successfully Jul 18 05:58:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fafac0-0e3e-464c-8a96-e9dca923a1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:35 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (3aae06f8-3ace-4e49-b6bd-aa9576c52542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:35 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4fbea9d4-eaf9-493c-95e5-446158e8fab0 tempest-ProjectMemberTests-1121035528 None] Created volume successfully. Jul 18 05:58:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:36 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Creating offline snapshot 69142730-3b48-4895-aa25-2090cd4d629c of volume 51a59302-a5fd-4fe3-85cf-0417b104e981 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:58:36 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d8ec49-ea9a-4b97-81b6-c15780e750a3]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:36 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 Jul 18 05:58:36 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:36 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981" returned: 0 in 0.367s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:36 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c 1G Jul 18 05:58:36 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:36 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c 1G" returned: 0 in 0.385s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:36 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a59302-a5fd-4fe3-85cf-0417b104e981 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:36 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a59302-a5fd-4fe3-85cf-0417b104e981 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c Jul 18 05:58:36 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:37 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51a59302-a5fd-4fe3-85cf-0417b104e981 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c" returned: 0 in 0.281s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:37 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c is being set with open permissions: ugo+rw Jul 18 05:58:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:37 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c Jul 18 05:58:37 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:37 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c" returned: 0 in 0.238s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:37 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.info Jul 18 05:58:37 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:37 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.info" returned: 0 in 0.257s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:37 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.info is being set with open permissions: ugo+rw Jul 18 05:58:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:37 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.info Jul 18 05:58:37 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:37 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.info" returned: 0 in 0.231s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:37 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:37 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-9bd0c379-d93b-4fd4-8ccd-f8bfed876224 tempest-ProjectMemberTests-1121035528 None] Create snapshot completed successfully Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-69142730-3b48-4895-aa25-2090cd4d629c-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-69142730-3b48-4895-aa25-2090cd4d629c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-51a59302-a5fd-4fe3-85cf-0417b104e981" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-51a59302-a5fd-4fe3-85cf-0417b104e981" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-69142730-3b48-4895-aa25-2090cd4d629c" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-69142730-3b48-4895-aa25-2090cd4d629c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Deleting offline snapshot 69142730-3b48-4895-aa25-2090cd4d629c of volume 51a59302-a5fd-4fe3-85cf-0417b104e981 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] snapshot_file for this snap is: volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf031ee0-03cf-4024-a5be-addef11602fb]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:38 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c Jul 18 05:58:38 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:38 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c" returned: 0 in 0.354s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51a59302-a5fd-4fe3-85cf-0417b104e981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf165be-4826-4772-ac8a-52bb42a1436d]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:38 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 Jul 18 05:58:38 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:38 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981" returned: 0 in 0.360s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:38 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:39 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c Jul 18 05:58:39 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:39 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c" returned: 0 in 0.333s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:39 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c Jul 18 05:58:39 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:39 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:39 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981.69142730-3b48-4895-aa25-2090cd4d629c" returned: 0 in 0.244s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-69142730-3b48-4895-aa25-2090cd4d629c" released by "_delete_snapshot" :: held 1.375s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-51a59302-a5fd-4fe3-85cf-0417b104e981" released by "delete_snapshot" :: held 1.394s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:39 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Created reservations ['16221e7a-b5ca-4df4-999f-9471052e2dd0', '1d7ea32f-15f2-4176-8ba8-fb169e643c10', '78fb93c8-1d55-4310-b6a3-bfdbf7750bf8', '119bbf74-c298-4509-821f-d3f25e75767b'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:39 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Delete snapshot completed successfully. Jul 18 05:58:39 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-0bc90328-24ad-4dcb-9ade-7c8378ccbe66 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-69142730-3b48-4895-aa25-2090cd4d629c-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-51a59302-a5fd-4fe3-85cf-0417b104e981-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-51a59302-a5fd-4fe3-85cf-0417b104e981-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-51a59302-a5fd-4fe3-85cf-0417b104e981" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:40 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-51a59302-a5fd-4fe3-85cf-0417b104e981" acquired by "delete_volume" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:40 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a708f2-5d3f-4b7b-8317-554f0e1fa1c3]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:40 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 Jul 18 05:58:40 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:40 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981" returned: 0 in 0.374s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:40 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:40 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981 Jul 18 05:58:40 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:41 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-51a59302-a5fd-4fe3-85cf-0417b104e981" returned: 0 in 0.241s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-51a59302-a5fd-4fe3-85cf-0417b104e981" released by "delete_volume" :: held 0.693s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Created reservations ['52cf2582-cd18-4f7f-a6e4-fe0b74e603ab', '9e9cab2f-362c-41eb-b96d-75b717fbff39', '93ed1060-d5d8-4fd5-9083-6b4f362f4f17', 'c6f4f198-4b4d-436e-a5b1-c58ae63c743e'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:41 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:41 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:41 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.257s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:41 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Deleted volume successfully. Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-a8d65949-ed37-403e-ac54-1a10dfba66c3 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-51a59302-a5fd-4fe3-85cf-0417b104e981-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (5f50abf0-27dc-47b5-b3c4-58fda7e92a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5c5e51-b242-4d36-8d6e-af93575d28f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5c5e51-b242-4d36-8d6e-af93575d28f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347828571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba1289d-3a5d-4921-8829-604b3cbab152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:42Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d77b71-1017-4d23-9437-723c7fa87a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d77b71-1017-4d23-9437-723c7fa87a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d47551f-b928-47cb-8403-17e7c28b34ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d47551f-b928-47cb-8403-17e7c28b34ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba1289d-3a5d-4921-8829-604b3cbab152', 'volume_name': 'volume-aba1289d-3a5d-4921-8829-604b3cbab152', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb407b5-7218-4f06-b1d6-efabb30eb730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb407b5-7218-4f06-b1d6-efabb30eb730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daae1eca-a6e1-40a1-a0a2-3d9257e0fc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:41 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Volume aba1289d-3a5d-4921-8829-604b3cbab152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba1289d-3a5d-4921-8829-604b3cbab152', 'volume_size': 1} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347828571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba1289d-3a5d-4921-8829-604b3cbab152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:42Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Creating volume aba1289d-3a5d-4921-8829-604b3cbab152 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:41 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:58:41 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:42 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 1073741824 Jul 18 05:58:42 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:42 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 1073741824" returned: 0 in 0.427s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:42 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 Jul 18 05:58:42 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:42 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152" returned: 0 in 0.234s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:42 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:42 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daae1eca-a6e1-40a1-a0a2-3d9257e0fc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba1289d-3a5d-4921-8829-604b3cbab152', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab128e46-7cc2-49da-b4bb-92bb4b3da43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:42 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Volume volume-aba1289d-3a5d-4921-8829-604b3cbab152 (aba1289d-3a5d-4921-8829-604b3cbab152): created successfully Jul 18 05:58:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab128e46-7cc2-49da-b4bb-92bb4b3da43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:42 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (5f50abf0-27dc-47b5-b3c4-58fda7e92a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:42 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-f79b84fd-05b0-41bb-898f-6972def7aa20 tempest-ProjectMemberTests-1121035528 None] Created volume successfully. Jul 18 05:58:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:43 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Creating offline snapshot fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 of volume aba1289d-3a5d-4921-8829-604b3cbab152 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:58:43 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd50d540-6e6a-42e1-a7f1-5c4adf8d90b2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:43 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 Jul 18 05:58:43 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:43 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152" returned: 0 in 0.360s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:43 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 1G Jul 18 05:58:43 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:43 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 1G" returned: 0 in 0.394s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:43 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aba1289d-3a5d-4921-8829-604b3cbab152 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:43 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aba1289d-3a5d-4921-8829-604b3cbab152 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 Jul 18 05:58:43 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:44 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aba1289d-3a5d-4921-8829-604b3cbab152 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412" returned: 0 in 0.287s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:44 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 is being set with open permissions: ugo+rw Jul 18 05:58:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:44 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 Jul 18 05:58:44 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:44 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412" returned: 0 in 0.249s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:44 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.info Jul 18 05:58:44 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:44 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.info" returned: 0 in 0.243s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:44 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.info is being set with open permissions: ugo+rw Jul 18 05:58:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:44 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.info Jul 18 05:58:44 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:44 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.info" returned: 0 in 0.250s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:44 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:44 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-6a15edd6-2041-4a84-9f85-a5b9ab2cb44e tempest-ProjectMemberTests-1121035528 None] Create snapshot completed successfully Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-fc3bed76-ecdb-4592-a0c0-0c32ad5e3412-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-fc3bed76-ecdb-4592-a0c0-0c32ad5e3412-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-aba1289d-3a5d-4921-8829-604b3cbab152" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-aba1289d-3a5d-4921-8829-604b3cbab152" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-fc3bed76-ecdb-4592-a0c0-0c32ad5e3412" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-fc3bed76-ecdb-4592-a0c0-0c32ad5e3412" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Deleting offline snapshot fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 of volume aba1289d-3a5d-4921-8829-604b3cbab152 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] snapshot_file for this snap is: volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07aac9a-4dd4-4696-bc0f-2d4dc0c7f9bc]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:45 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 Jul 18 05:58:45 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:45 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412" returned: 0 in 0.353s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aba1289d-3a5d-4921-8829-604b3cbab152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e994fd74-01b1-4930-be75-6d6634b66d97]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:45 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:45 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 Jul 18 05:58:45 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:46 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152" returned: 0 in 0.347s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:46 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 Jul 18 05:58:46 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:46 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412" returned: 0 in 0.339s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:46 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412 Jul 18 05:58:46 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:46 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:46 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152.fc3bed76-ecdb-4592-a0c0-0c32ad5e3412" returned: 0 in 0.248s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-fc3bed76-ecdb-4592-a0c0-0c32ad5e3412" released by "_delete_snapshot" :: held 1.375s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-aba1289d-3a5d-4921-8829-604b3cbab152" released by "delete_snapshot" :: held 1.396s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:46 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Created reservations ['3da38ea2-6ffa-4e87-91cc-b13b887342bf', '5b92b6bc-448b-4096-aca1-49b0acc79724', '80ad01da-b8ce-417b-88e0-99194a7ce8ea', '992ea70d-1ccf-4735-9e02-36fb7d142905'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:46 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Delete snapshot completed successfully. Jul 18 05:58:46 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-7cf311f7-ad17-4b23-9241-b6d5d996a231 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-fc3bed76-ecdb-4592-a0c0-0c32ad5e3412-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-aba1289d-3a5d-4921-8829-604b3cbab152-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-aba1289d-3a5d-4921-8829-604b3cbab152-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-aba1289d-3a5d-4921-8829-604b3cbab152" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:47 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-aba1289d-3a5d-4921-8829-604b3cbab152" acquired by "delete_volume" :: waited 0.015s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:47 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bdcc34-0fe3-4214-878f-7998b0fe72eb]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:47 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 Jul 18 05:58:47 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:47 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152" returned: 0 in 0.351s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:47 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:47 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152 Jul 18 05:58:47 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:48 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-aba1289d-3a5d-4921-8829-604b3cbab152" returned: 0 in 0.244s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-aba1289d-3a5d-4921-8829-604b3cbab152" released by "delete_volume" :: held 0.652s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Created reservations ['8e464008-e32a-496a-bde6-e9a4add061d7', 'd5053f66-370f-44ac-90c2-6dc3ddb76840', 'c9ff606e-dd4d-498a-aacb-a29b21bed49a', 'eb93f5c0-1657-4d2f-a4ce-70d27ca1aee9'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:48 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:48 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:48 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.249s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:48 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Deleted volume successfully. Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-c67dddb3-bee1-4493-a09d-8a6cf83d55d8 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-aba1289d-3a5d-4921-8829-604b3cbab152-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (9349376f-ad36-4bf4-87e6-30577f2c4ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:48 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e59cd-d2a4-43d3-8499-b4c2969b3e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e59cd-d2a4-43d3-8499-b4c2969b3e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40525049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0275743-7726-4268-b602-83b4f905f0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:49Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d522c42-fbf7-4af1-b401-9d41986258fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d522c42-fbf7-4af1-b401-9d41986258fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10be3b1d-d361-4c46-843d-1e1e89c2638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10be3b1d-d361-4c46-843d-1e1e89c2638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0275743-7726-4268-b602-83b4f905f0a2', 'volume_name': 'volume-b0275743-7726-4268-b602-83b4f905f0a2', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65383524-8ba6-4ee5-a887-5c9cc4f37a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65383524-8ba6-4ee5-a887-5c9cc4f37a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856f4acb-c89c-4041-8d20-f74fddbfbc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:49 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Volume b0275743-7726-4268-b602-83b4f905f0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0275743-7726-4268-b602-83b4f905f0a2', 'volume_size': 1} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40525049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0275743-7726-4268-b602-83b4f905f0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a87109b2034f18ac89bfb2e52483f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:49Z,use_quota=True,user_id='545c1addbd8b4ad9829b41d8076a13c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5654734-615d-40c5-b054-d15bc08138b9),volume_type_id=b5654734-615d-40c5-b054-d15bc08138b9)}" {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Creating volume b0275743-7726-4268-b602-83b4f905f0a2 {{(pid=87497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Selected osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 as target Quobyte volume. {{(pid=87497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:49 devstack cinder-volume[87497]: INFO cinder.volume.drivers.remotefs [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] casted to osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13 Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 1073741824 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:49 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 1073741824 Jul 18 05:58:49 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:49 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 1073741824" returned: 0 in 0.409s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:49 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 Jul 18 05:58:49 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:49 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2" returned: 0 in 0.243s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'} {{(pid=87497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856f4acb-c89c-4041-8d20-f74fddbfbc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0275743-7726-4268-b602-83b4f905f0a2', 'volume_size': 1}' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98cb99d-7812-4bab-82f1-453f5bff134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:49 devstack cinder-volume[87497]: INFO cinder.volume.flows.manager.create_volume [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Volume volume-b0275743-7726-4268-b602-83b4f905f0a2 (b0275743-7726-4268-b602-83b4f905f0a2): created successfully Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98cb99d-7812-4bab-82f1-453f5bff134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:49 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Flow 'volume_create_manager' (9349376f-ad36-4bf4-87e6-30577f2c4ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:49 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-4823ae5e-4862-4f49-949b-9304a83b4647 tempest-ProjectMemberTests-1121035528 None] Created volume successfully. Jul 18 05:58:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:50 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Creating offline snapshot f7c829bd-9045-4e25-9754-68e8d0b23dcb of volume b0275743-7726-4268-b602-83b4f905f0a2 {{(pid=87497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 05:58:50 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad1e56-a953-4a56-a414-956631e9e529]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:50 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 Jul 18 05:58:50 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:50 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2" returned: 0 in 0.346s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb 1G {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:50 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb 1G Jul 18 05:58:50 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:50 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb 1G" returned: 0 in 0.395s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:50 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0275743-7726-4268-b602-83b4f905f0a2 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:50 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0275743-7726-4268-b602-83b4f905f0a2 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb Jul 18 05:58:50 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:51 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0275743-7726-4268-b602-83b4f905f0a2 -F qcow2 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb" returned: 0 in 0.291s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:51 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb is being set with open permissions: ugo+rw Jul 18 05:58:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:51 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb Jul 18 05:58:51 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:51 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb" returned: 0 in 0.241s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:51 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.info Jul 18 05:58:51 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:51 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.info" returned: 0 in 0.248s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:51 devstack cinder-volume[87497]: WARNING cinder.volume.drivers.remotefs [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.info is being set with open permissions: ugo+rw Jul 18 05:58:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.info {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:51 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.info Jul 18 05:58:51 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:51 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.info" returned: 0 in 0.235s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:51 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:52 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-885dde73-157c-4ead-ab17-e5d7bd8c1c3e tempest-ProjectMemberTests-1121035528 None] Create snapshot completed successfully Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-f7c829bd-9045-4e25-9754-68e8d0b23dcb-delete_snapshot" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-f7c829bd-9045-4e25-9754-68e8d0b23dcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-b0275743-7726-4268-b602-83b4f905f0a2" by "delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-b0275743-7726-4268-b602-83b4f905f0a2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-f7c829bd-9045-4e25-9754-68e8d0b23dcb" by "_delete_snapshot" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-f7c829bd-9045-4e25-9754-68e8d0b23dcb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Deleting offline snapshot f7c829bd-9045-4e25-9754-68e8d0b23dcb of volume b0275743-7726-4268-b602-83b4f905f0a2 {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] snapshot_file for this snap is: volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb {{(pid=87497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c950eb3-a139-4b90-9aa7-01ed4e4e8eff]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:52 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb Jul 18 05:58:52 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:52 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb" returned: 0 in 0.357s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.remotefs [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0275743-7726-4268-b602-83b4f905f0a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e33661-a715-42c8-b03d-8e4f7dd832fb]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:52 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:52 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 Jul 18 05:58:52 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:53 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2" returned: 0 in 0.365s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:53 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb Jul 18 05:58:53 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:53 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb" returned: 0 in 0.331s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:53 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb Jul 18 05:58:53 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:53 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:53 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2.f7c829bd-9045-4e25-9754-68e8d0b23dcb" returned: 0 in 0.240s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-f7c829bd-9045-4e25-9754-68e8d0b23dcb" released by "_delete_snapshot" :: held 1.386s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-b0275743-7726-4268-b602-83b4f905f0a2" released by "delete_snapshot" :: held 1.406s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:53 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Created reservations ['3677adfc-43ce-46a5-b6ec-95a2986767bf', '0f9038db-cf07-40f6-bde9-3a813427f364', '25d2484c-bb72-4e5d-844a-fbab90a0c18c', 'fa5f3251-bf22-4b1a-8ac8-b466d4d85a09'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:53 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Delete snapshot completed successfully. Jul 18 05:58:53 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-dd7e20c0-5c05-4a2a-9d2d-82dfb290fd62 tempest-ProjectMemberTests-1121035528 None] Lock "cinder-f7c829bd-9045-4e25-9754-68e8d0b23dcb-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-b0275743-7726-4268-b602-83b4f905f0a2-delete_volume" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-b0275743-7726-4268-b602-83b4f905f0a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Acquiring lock "cinder-quobyte-b0275743-7726-4268-b602-83b4f905f0a2" by "delete_volume" {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:54 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-b0275743-7726-4268-b602-83b4f905f0a2" acquired by "delete_volume" :: waited 0.013s {{(pid=87497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:54 devstack cinder-volume[87497]: DEBUG oslo.privsep.daemon [-] privsep: reply[142760ba-7ca2-489b-9b1d-3eadba2d17d2]: (4, 'qcow2') {{(pid=88960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:54 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 Jul 18 05:58:54 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:54 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2" returned: 0 in 0.341s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:54 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2 Jul 18 05:58:54 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:55 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc/volume-b0275743-7726-4268-b602-83b4f905f0a2" returned: 0 in 0.248s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-quobyte-b0275743-7726-4268-b602-83b4f905f0a2" released by "delete_volume" :: held 0.641s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG cinder.quota [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Created reservations ['281e5bb4-3f4d-4bd8-adaa-be243f2c8dfc', '1d71b15e-23bd-454a-a100-ade296263248', '60d92289-ef02-47c4-8b37-6c177b2dc394', '8d112385-66a0-4357-a3ad-4f68baea7751'] {{(pid=87497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:55 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:58:55 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:55 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.242s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Deleted volume successfully. Jul 18 05:58:55 devstack cinder-volume[87497]: DEBUG cinder.coordination [None req-112c3e1b-97a3-4d01-91aa-ce501582070e tempest-ProjectMemberTests-1121035528 None] Lock "cinder-b0275743-7726-4268-b602-83b4f905f0a2-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:59:05 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=85,cinder:UPDATE=123,cinder:DELETE=11,cinder:INSERT=27 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:59:05 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=97,cinder:INSERT=41,cinder:UPDATE=123,cinder:DELETE=9 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13': None} {{(pid=87497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG cinder.volume.drivers.quobyte [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7cb4dfc5-0646-4637-add7-cf154cef9c13'] {{(pid=87497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:06 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc Jul 18 05:59:06 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:06 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG oslo_concurrency.processutils [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1d3b582a55c58ae5eff86e377e1362dc" returned: 0 in 0.244s {{(pid=87497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG cinder.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Notifying Schedulers of capabilities ... {{(pid=87497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG oslo_service.periodic_task [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] Running periodic task VolumeManager._thread_info {{(pid=87497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread count: 28 {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:59:06 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-f120f1fa-cf4c-4b5f-84b6-82833544bbdc None None] thread info: [<_MainThread(MainThread, started 134945248137344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}